If you know nothing about deep learning with Python, start here – TechTalks
Posted: February 13, 2021 at 10:52 pm
This article is part ofAI education, a series of posts that review and explore educational content on data science and machine learning. (In partnership withPaperspace)
Teaching yourself deep learning is a long and arduous process. You need a strong background in linear algebra and calculus, good Python programming skills, and a solid grasp of data science, machine learning, and data engineering. Even then, it can take more than a year of study and practice before you reach the point where you can start applying deep learning to real-world problems and possibly land a job as a deep learning engineer.
Knowing where to start, however, can help a lot in softening the learning curve. If I had to learn deep learning with Python all over again, I would start with Grokking Deep Learning, written by Andrew Trask. Most books on deep learning require a basic knowledge of machine learning concepts and algorithms. Trasks book teaches you the fundamentals of deep learning without any prerequisites aside from basic math and programming skills.
The book wont make you a deep learning wizard (and it doesnt make such claims), but it will set you on a path that will make it much easier to learn from more advanced books and courses.
Most deep learning books are based on one of several popular Python libraries such as TensorFlow, PyTorch, or Keras. In contrast, Grokking Deep Learning teaches you deep learning by building everything from scratch, line by line.
You start with developing a single artificial neuron, the most basic element of deep learning. Trask takes you through the basics of linear transformations, the main computation done by an artificial neuron. You then implement the artificial neuron in plain Python code, without using any special libraries.
This is not the most efficient way to do deep learning, because Python has many libraries that take advantage of your computers graphics card and parallel processing power of your CPU to speed up computations. But writing everything in vanilla Python is excellent for learning the ins and outs of deep learning.
In Grokking Deep Learning, your first artificial neuron will take a single input, multiply it by a random weight, and make a prediction. Youll then measure the prediction error and apply gradient descent to tune the neurons weight in the right direction. With a single neuron, single input, and single output, understanding and implementing the concept becomes very easy. Youll gradually add more complexity to your models, using multiple input dimensions, predicting multiple outputs, applying batch learning, adjusting learning rates, and more.
And youll implement every new concept by gradually adding and changing bits of Python code youve written in previous chapters, gradually creating a roster of functions for making predictions, calculating errors, applying corrections, and more. As you move from scalar to vector computations, youll shift from vanilla Python operations to Numpy, a library that is especially good at parallel computing and is very popular among the machine learning and deep learning community.
With the basic building blocks of artificial neurons under your belt, youll start creating deep neural networks, which is basically what you get when you stack several layers of artificial neurons on top of each other.
As you create deep neural networks, youll learn about activation functions and apply them to break the linearity of the stacked layers and create classification outputs. Again, youll implement everything yourself with the help of Numpy functions. Youll also learn to compute gradients and propagate errors through layers to spread corrections across different neurons.
As you get more comfortable with the basics of deep learning, youll get to learn and implement more advanced concepts. The book features some popular regularization techniques such as early stopping and dropout. Youll also get to craft your own version of convolutional neural networks (CNN) and recurrent neural networks (RNN).
By the end of the book, youll pack everything into a complete Python deep learning library, creating your own class hierarchy of layers, activation functions, and neural network architectures (youll need object-oriented programming skills for this part). If youve already worked with other Python libraries such as Keras and PyTorch, youll find the final architecture to be quite familiar. If you havent, youll have a much easier time getting comfortable with those libraries in the future.
And throughout the book, Trask reminds you that practice makes perfect; he encourages you to code your own neural networks by heart without copy-pasting anything.
Not everything about Grokking Deep Learning is perfect. In a previous post, I said that one of the main things that defines a good book is the code repository. And in this area, Trask could have done a much better job.
The GitHub repository of Grokking Deep Learning is rich with Jupyter Notebook files for every chapter. Jupyter Notebook is an excellent tool for learning Python machine learning and deep learning. However, the strength of Jupyter is in breaking down code into several small cells that you can execute and test independently. Some of Grokking Deep Learnings notebooks are composed of very large cells with big chunks of uncommented code.
This becomes especially problematic in the later chapters, where the code becomes longer and more complex, and finding your way in the notebooks becomes very tedious. As a matter of principle, the code for educational material should be broken down into small cells and contain comments in key areas.
Also, Trask has written the code in Python 2.7. While he has made sure that the code also works smoothly in Python 3, it contains old coding techniques that have become deprecated among Python developers (such as using the for i in range(len(array)) paradigm to iterate over an array).
Trask has done a great job of putting together a book that can serve both newbies and experienced Python deep learning developers who want to fill the gaps in their knowledge.
But as Tywin Lannister says (and every engineer will agree), Theres a tool for every task, and a task for every tool. Deep learning isnt a magic wand that can solve every AI problem. In fact, for many problems, simpler machine learning algorithms such as linear regression and decision trees will perform as well as deep learning, while for others, rule-based techniques such as regular expressions and a couple of if-else clauses will outperform both.
The point is, youll need a full arsenal of tools and techniques to solve AI problems. Hopefully, Grokking Deep Learning will help get you started on the path to acquiring those tools.
Where do you go from here? I would certainly suggest picking up an in-depth book on Python deep learning such as Deep Learning With PyTorch or Deep Learning With Python. You should also deepen your knowledge of other machine learning algorithms and techniques. Two of my favorite books are Hands-on Machine Learning and Python Machine Learning.
You can also pick up a lot of knowledge browsing machine learning and deep learning forums such as the r/MachineLearning and r/deeplearning subreddits, the AI and deep learning Facebook group, or by following AI researchers on Twitter.
The AI universe is vast and quickly expanding, and there is a lot to learn. If this is your first book on deep learning, then this is the beginning of an amazing journey.
Subscribe to get the latest updates from TechTalks:
Continue reading here:
If you know nothing about deep learning with Python, start here - TechTalks
- Getting Started With Machine Learning: Definition and Applications - CMSWire - February 20th, 2021
- This Biotech Company Combines Single Cell Genomics with Machine Learning (ML) Algorithms To Enable High Resolution Profiling of the Immune System -... - February 20th, 2021
- Immunai Raises $60M to Decode the Immune System with Machine Learning and AI - AlleyWatch - February 20th, 2021
- Cloud Machine Learning Market: Indoor Applications Projected to be the Most Attractive Segment during 2021-2029 KSU | The Sentinel Newspaper - KSU |... - February 20th, 2021
- Machine Learning in Insurance Market: Indoor Applications Projected to be the Most Attractive Segment during 2021-2029 KSU | The Sentinel Newspaper -... - February 20th, 2021
- Carin Meier Using Machine Learning to Combat Major Illness, such as the Coronavirus - InfoQ.com - February 20th, 2021
- Moffitt Cancer Center: Why we are building the first machine learning department in oncology - The Cancer Letter - February 20th, 2021
- Machine Learning and where is it used? - Tech Guide - February 20th, 2021
- Artificial Intelligence and Machine Learning for Insurance Technology from Johnson Controls Available on the Ocean Tomo Bid-Ask Market - Yahoo Finance - February 20th, 2021
- Identifying COVID-19 Therapy Candidates With Machine Learning - Contagionlive.com - February 20th, 2021
- Machine Learning in Tax and Accounting Market gigantic revenues by 2028 with Amazon Web Services, Baidu Inc, Google, Intel, IBM, Hewlett Packard,... - February 20th, 2021
- Using AI and Machine Learning will increase in horti industry - hortidaily.com - February 13th, 2021
- The head of JPMorgan's machine learning platform explained what it's like to work there - eFinancialCareers - February 13th, 2021
- Mental health diagnoses and the role of machine learning - Health Europa - February 13th, 2021
- 5 Ways the IoT and Machine Learning Improve Operations - BOSS Magazine - February 13th, 2021
- There Is No Silver Bullet Machine Learning Solution - Analytics India Magazine - February 13th, 2021
- Postdoctoral Research Associate in Digital Humanities and Machine Learning job with DURHAM UNIVERSITY | 246392 - Times Higher Education (THE) - February 13th, 2021
- The Collision of AI's Machine Learning and Manipulation: Deepfake Litigation Risks to Companies from a Product Liability, Privacy, and Cyber... - February 13th, 2021
- Parascript and SFORCE Partner to Leverage Machine Learning Eliminating Barriers to Automation - GlobeNewswire - February 13th, 2021
- Rackspace Technology Study uncovers AI and Machine Learning knowledge gap in the UAE - Intelligent CIO ME - February 13th, 2021
- How Blockchain and Machine Learning Impact on education system - ABCmoney.co.uk - February 13th, 2021
- Mission Healthcare of San Diego Adopts Muse Healthcare's Machine Learning Tool - Southernminn.com - January 19th, 2021
- Deep Learning Outperforms Standard Machine Learning in Biomedical Research Applications, Research Shows - Georgia State University News - January 19th, 2021
- Project MEDAL to apply machine learning to aero innovation - The Engineer - January 19th, 2021
- Forecast On Machine Learning (ML) Intelligent Process Automation Market Witness the Growth of Great Billion by 2027 With Top Companies Like Automation... - January 19th, 2021
- Machine Learning Shown to Identify Patient Response to Sarilumab in Rheumatoid Arthritis - AJMC.com Managed Markets Network - January 19th, 2021
- Bangalore based Great Learning can help you unleash the potential of an M-Tech in Data Science & Machine - Times of India - January 19th, 2021
- CERC plans to embrace AI, machine learning to improve functioning - Business Standard - January 19th, 2021
- NTT Co-authored Papers at NeurIPS to Advance Machine Learning Efficiency and Performance - Business Wire - December 7th, 2020
- Why Intel believes confidential computing will boost AI and machine learning - VentureBeat - December 3rd, 2020
- Machine Learning Market to Grow Notably Attributed to Increasing Adoption of Analytics-driven Solutions by Developing Economies, says Fortune Business... - December 3rd, 2020
- Machine learning: The new language of data and analytics - ITProPortal - December 3rd, 2020
- Injecting Machine Learning And Bayesian Optimization Into HPC - The Next Platform - December 3rd, 2020
- QA Increasingly Benefits from AI and Machine Learning - RTInsights - December 3rd, 2020
- Everything to Know About Machine Learning as a Service (MLaaS) - Analytics Insight - December 3rd, 2020
- How the Food and Beverage Industry is Affected by Machine Learning and AI - IoT For All - December 3rd, 2020
- Amazon announces new machine learning tools to help customers monitor machines and worker safety - www.computing.co.uk - December 3rd, 2020
- Machine Learning and Location Data Applications Market 2020 Top Companies report covers, Industry Outlook, Top Countries Analysis & Top... - December 3rd, 2020
- Commentary: Chain of Demand applies AI, machine learning to retail supply chain profitability - FreightWaves - December 3rd, 2020
- Machine learning - it's all about the data - KHL Group - December 3rd, 2020
- Product Portfolio Analysis and Technological Development of Machine Learning in Medical Imaging Market during the forecasted period - Murphy's Hockey... - December 3rd, 2020
- Imaging AI and Machine Learning Beyond the Hype, Upcoming Webinar Hosted by Xtalks - PR Web - December 3rd, 2020
- Veritone aiWARE Now Supports NVIDIA CUDA for GPU-based AI and Machine Learning - Business Wire - December 3rd, 2020
- Exactech Launches Predict+, First Machine Learning-Based Software that Informs Surgeons with Patient-Specific Outcomes Predictions After Shoulder... - December 3rd, 2020
- How To Choose The Best Machine Learning Algorithm For A Particular Problem? - Analytics India Magazine - October 19th, 2020
- Lantronix Brings Advanced AI and Machine Learning to Smart Cameras With New Open-Q 610 SOM Based on the Powerful Qualcomm QCS610 System on Chip (SOC)... - October 19th, 2020
- AI and Machine Learning Technologies Expected to Play a Key Role in Expanding Multi Billion Dollar Digital Banking Sector: Report - Crowdfund Insider - October 19th, 2020
- AutoML Alleviates the Process of Machine Learning Analysis - Analytics Insight - October 19th, 2020
- Futurism Reinforces Its Next-Gen Business Commerce Platform With Advanced Machine Learning and Artificial Intelligence Capabilities - Yahoo Finance - October 19th, 2020
- Purebase Enhances Its Board of Advisors with An Expert on Machine Learning and Cheminformatics - GlobeNewswire - October 19th, 2020
- COVID-19 And The Role Of AI, Machine Learning In Logistics: A Conversation With Delhivery CTO Kapil Bharati - Mashable India - October 19th, 2020
- How to Beat Analysts and the Stock Market with Machine Learning - Knowledge@Wharton - October 19th, 2020
- AI and Machine Learning Can Help Fintechs if We Focus on Practical Implementation and Move Away from Overhyped Narratives, Researcher Says - Crowdfund... - October 19th, 2020
- Proximity matters: Using machine learning and geospatial analytics to reduce COVID-19 exposure risk - Healthcare IT News - September 20th, 2020
- PREDICTING THE OPTIMUM PATH - Port Strategy - September 20th, 2020
- What is 'custom machine learning' and why is it important for programmatic optimisation? - The Drum - September 20th, 2020
- How Machine Learning is Set to Transform the Online Gaming Community - Techiexpert.com - TechiExpert.com - September 20th, 2020
- Current and future regulatory landscape for AI and machine learning in the investment management sector - Lexology - September 20th, 2020
- Global Machine Learning Courses Market Research Report 2015-2027 of Major Types, Applications and Competitive Vendors in Top Regions and Countries -... - September 20th, 2020
- When AI in healthcare goes wrong, who is responsible? - Quartz - September 20th, 2020
- Is Wide-Spread Use of AI & Machine Intelligence in Manufacturing Still Years Away? - Automation World - September 20th, 2020
- How do we know AI is ready to be in the wild? Maybe a critic is needed - ZDNet - September 20th, 2020
- Solving the crux behind Apple's Silicon Strategy - Medium - September 20th, 2020
- Boost Your Animation To 60 FPS Using AI - Hackaday - September 20th, 2020
- 50 Latest Data Science And Analytics Jobs That Opened Last Week - Analytics India Magazine - September 20th, 2020
- Algorithms may never really figure us out thank goodness - The Boston Globe - September 20th, 2020
- Why Deep Learning DevCon Comes At The Right Time - Analytics India Magazine - September 20th, 2020
- Six notable benefits of AI in finance, and what they mean for humans - Daily Maverick - September 20th, 2020
- Twitter is looking into why its photo preview appears to favor white faces over Black faces - The Verge - September 20th, 2020
- 8 Trending skills you need to be a good Python Developer - iLounge - September 20th, 2020
- Automation Continuum - Leveraging AI and ML to Optimise RPA - Analytics Insight - September 20th, 2020
- UT Austin Selected as Home of National AI Institute Focused on Machine Learning - UT News | The University of Texas at Austin - August 27th, 2020
- Participation-washing could be the next dangerous fad in machine learning - MIT Technology Review - August 27th, 2020
- Getting to the heart of machine learning and complex humans - The Irish Times - August 27th, 2020
- Air Force Taps Machine Learning to Speed Up Flight Certifications - Nextgov - August 27th, 2020
- The Role of Artificial Intelligence and Machine Learning in the... - Insurance CIO Outlook - August 27th, 2020
- AI and Machine Learning Network Fetch.ai Partners Open-Source Blockchain Protocol Waves to Conduct R&D on DLT - Crowdfund Insider - August 27th, 2020
- AI may not predict the next pandemic, but big data and machine learning can fight this one - ZDNet - August 27th, 2020
- Machine Learning Artificial intelligence Market Size and Growth By Leading Vendors, By Types and Application, By End Users and Forecast to 2020-2027 -... - August 27th, 2020
- Explainable AI: From the peak of inflated expectations to the pitfalls of interpreting machine learning models - ZDNet - August 27th, 2020