Added audio in 6 pages
This commit is contained in:
1 parent
c079a055e8
commit
66a2b20bfc
24 files changed
+86
-540
No files matched your search
@@ -0,0 +1,84 @@
|
||||
## Deep Learning: Principles, Applications, and Challenges
|
||||
|
||||
:::tip
|
||||
You can listen and follow along with your reading.
|
||||
<audio controls>
|
||||
<source src="/audio/Deep Learning.wav" type="audio/mpeg" />
|
||||
Your browser does not support the audio element.
|
||||
</audio>
|
||||
:::
|
||||
|
||||
**Deep learning** is a **subset of machine learning (ML)** that utilizes **multilayered artificial neural networks** (also known as deep neural networks) to learn autonomously from large amounts of data, identify complex patterns, and make decisions or predictions with minimal human intervention. It forms the foundation for most artificial intelligence (AI) applications in use today. The term "deep" refers to the presence of multiple layers—typically **three or more hidden layers**, but often hundreds or even thousands—between the input and output layers in its neural network architecture.
|
||||
|
||||
### Relationship within AI
|
||||
|
||||
Artificial intelligence is the broadest concept, aiming to enable machines to perform tasks that typically require human intelligence, such as reasoning, learning, and problem-solving. **Machine learning is a subset of AI** that allows machines to learn from data and improve performance on specific tasks without explicit programming. Deep learning, in turn, is a **specialised type of machine learning** that employs multi-layered neural networks. This creates a clear hierarchy: Deep Learning ⊂ Machine Learning ⊂ Artificial Intelligence.
|
||||
|
||||
### How Deep Learning Works
|
||||
|
||||
Deep learning models are "trained" by being exposed to vast amounts of data. This process involves feeding the model input data, allowing it to make predictions, and then **iteratively adjusting its internal parameters** (such as weights and biases) to minimise errors between its predictions and the actual outcomes. This iterative refinement leads to continuous improvement in accuracy over time.
|
||||
|
||||
A key difference from traditional machine learning is deep learning's ability to perform **automatic feature extraction**. Instead of requiring humans to manually select, transform, and create relevant input features from raw data, deep learning models learn these features hierarchically through their layers directly from the data itself. This reduces the need for human intervention in feature engineering.
|
||||
|
||||
The learning process within a deep neural network often involves:
|
||||
|
||||
- **Forward Propagation**: Data moves through the network's layers from the input layer to the output layer, where a prediction or classification is made.
|
||||
- **Backpropagation**: Algorithms (like gradient descent) calculate the errors in these predictions and then adjust the weights and biases of the network by moving backwards through the layers to refine the model. This process aims to minimise a "loss function" (or maximise a "reward function" in reinforcement learning), which quantifies the model's error.
|
||||
|
||||
### Data and Hardware Requirements
|
||||
|
||||
Deep learning models are particularly powerful for analysing **large amounts of unstructured data** like images, audio, and text. However, this power comes with significant requirements:
|
||||
|
||||
- **Data Volume**: Deep learning models need **very large datasets** for effective training, often millions of data points. The more data, the better the model's performance.
|
||||
- **Computational Power**: Training complex deep neural networks demands **significant computing resources**, typically requiring **high-performance graphical processing units (GPUs)** or specialised processors like Google's Tensor Processing Units (TPUs) due to the massive parallel computations involved.
|
||||
|
||||
### Types of Deep Learning Models/Architectures
|
||||
|
||||
Deep learning utilises various neural network architectures, each suited to different tasks:
|
||||
|
||||
- **Feedforward Neural Networks (FFNNs)**: One of the oldest types, where data flows in one direction through layers of artificial neurons to produce an output. Modern FFNNs are often "deep feedforward" with multiple hidden layers.
|
||||
- **Recurrent Neural Networks (RNNs)**: Designed for **sequential data** (like time series or language), RNNs have "memory" of previous layers' outputs, allowing them to process sequences by considering prior inputs.
|
||||
- **Long Short-Term Memory (LSTM)**: An advanced form of RNN particularly effective for language modelling and speech recognition, capable of "remembering" information across many layers due to "memory cells".
|
||||
- **Convolutional Neural Networks (CNNs)**: Most commonly used in **computer vision and image classification**, CNNs employ distinct layers (convolutional, pooling, fully connected) to filter and identify features within images and videos, starting from simple elements like colours and edges, and progressing to more complex shapes.
|
||||
- **Autoencoders and Variational Autoencoders (VAEs)**: Among the first models widely used for generating realistic images and speech, they compress data into dense representations and then reconstruct it, enabling anomaly detection, classification, and generative modelling.
|
||||
- **Generative Adversarial Networks (GANs)**: Involve two competing neural networks—a "generator" that creates content and a "discriminator" that evaluates its realism—to improve the quality of generated output.
|
||||
- **Transformers**: A powerful non-recurrent architecture that has revolutionised language models. They use a **self-attention mechanism** to process entire sequences in parallel, allowing them to understand the context of each word by considering its relation to every other word. Transformers are foundational for modern Large Language Models (LLMs).
|
||||
|
||||
### Benefits of Deep Learning
|
||||
|
||||
Deep learning offers several advantages:
|
||||
|
||||
- **Automation**: Automates tasks and workflows that previously required human intervention.
|
||||
- **Actionable Insights**: Identifies patterns and trends in massive datasets that humans might miss.
|
||||
- **Predictive Capabilities**: Enables accurate predictions and forecasting across various domains.
|
||||
- **Efficiency and Productivity**: Streamlines processes and improves productivity by handling complex tasks at tremendous scale.
|
||||
- **Personalisation**: Provides personalised experiences by learning from individual interactions.
|
||||
- **Accessibility**: Pre-trained models and modular platforms (like Hugging Face) make deep learning more accessible, reducing development time and resource requirements.
|
||||
|
||||
### Applications of Deep Learning
|
||||
|
||||
Deep learning is widely applied across numerous industries and technologies:
|
||||
|
||||
- **Speech Recognition**: Powers virtual assistants (e.g., Siri, Alexa) by converting spoken language to text.
|
||||
- **Image Recognition and Computer Vision**: Used in facial recognition, self-driving cars, and medical image analysis, allowing systems to identify and categorise aspects of images and videos.
|
||||
- **Natural Language Processing (NLP)**: Enables understanding, interpretation, and generation of human language, powering chatbots, summarisers, and translation services.
|
||||
- **Generative AI**: Creates original content (text, images, video, code) by learning from patterns in existing content.
|
||||
- **Recommendation Systems**: Suggests products, content, or services based on past behaviour and preferences.
|
||||
- **Fraud Detection**: Analyses transaction patterns to flag anomalies indicative of fraud.
|
||||
- **Healthcare**: Aids in diagnostics and medical image analysis, and accelerates drug development.
|
||||
- **Materials Science**: Used to discover new materials and accelerate material innovation.
|
||||
- **Finance**: Used for algorithmic trading and assessing business risks.
|
||||
- **Robotics**: Enables robots to learn new tasks through observation.
|
||||
- **Weather Prediction**: Models trained on historical data can predict weather conditions globally with high precision and speed.
|
||||
|
||||
### Challenges and Limitations
|
||||
|
||||
Despite its advancements, deep learning faces several challenges:
|
||||
|
||||
- **Data Requirements**: It requires **vast amounts of high-quality, accurate, and unbiased training data**. "Garbage in, garbage out" is a significant concern.
|
||||
- **Computational Resources**: Training complex models demands **significant computing power** and considerable energy.
|
||||
- **Interpretability ("Black Box" Problem)**: Many complex deep learning models are often considered "black boxes," making it **difficult to understand _why_ they make specific decisions** or how their inner workings lead to a particular output.
|
||||
- **Bias and Unintended Outcomes**: Models trained on human-generated data can **inherit and perpetuate human biases and existing inequities**, leading to discriminatory outputs.
|
||||
- **Accuracy Limitations**: While highly accurate, deep learning models are not always perfect. For critical tasks, very high accuracy is required, and current models are estimated to perform at about 95% of human accuracy.
|
||||
- **Security Vulnerabilities**: Artificial neural networks are vulnerable to adversarial attacks, where subtle changes to inputs can trick the model into misclassifying data. Data poisoning can also prevent models from achieving mastery.
|
||||
- **Scalability**: While deep learning enables large-scale machine learning, optimising large models with many layers and parameters can add complexity and long training times.
|
||||
@@ -0,0 +1,47 @@
|
||||
---
|
||||
sidebar_position: 1
|
||||
---
|
||||
|
||||
## The World of Artificial Intelligence: An Overview
|
||||
|
||||
:::tip
|
||||
You can listen and follow along with your reading.
|
||||
<audio controls>
|
||||
<source src="/audio/Definition of AI.wav" type="audio/mpeg" />
|
||||
Your browser does not support the audio element.
|
||||
</audio>
|
||||
:::
|
||||
|
||||
Artificial intelligence (AI) is a broad field of computer science and technology focused on creating machines and computer systems that can **simulate or replicate human intelligence**. Its fundamental goal is to enable software and machines to **reason, learn, and act in ways that would normally require human cognitive abilities**.
|
||||
|
||||
### Core Capabilities and Functions of AI
|
||||
|
||||
AI systems are designed to perform a variety of advanced functions, including:
|
||||
|
||||
- **Learning from data and experience**: AI systems learn and improve through exposure to vast amounts of data, identifying patterns and relationships that humans might miss. This learning process often involves algorithms trained on various datasets.
|
||||
- **Understanding and processing natural language (NLP)**: This capability allows computers to comprehend and generate human language, improving communication interfaces and enabling sophisticated tasks like translation, sentiment analysis, and conversational AI.
|
||||
- **Recognising objects and patterns**: This includes computer vision, which enables systems to extract, analyse, and comprehend spatial information from visual data for tasks such as image recognition, object detection, and classifying images.
|
||||
- **Making recommendations and predictions**: AI can mine data to forecast specific outcomes, such as the future performance of sports players or provide recommendations in e-commerce.
|
||||
- **Automating tasks and acting independently**: AI can automate routine, repetitive, and often tedious or dangerous tasks, freeing human capital for higher-value work. This autonomous action is exemplified by self-driving cars.
|
||||
|
||||
### Relationship with other AI Concepts
|
||||
|
||||
AI is a broad field that encompasses many different disciplines and technologies:
|
||||
|
||||
- **Machine Learning (ML)**: This is a subset of AI that allows machines to extract knowledge from data and learn from it autonomously without being explicitly programmed for every scenario.
|
||||
- **Deep Learning**: A further specialisation within machine learning, deep learning uses multi-layered artificial neural networks (DNNs) that mimic the structure of the human brain to process information and learn complex patterns directly from large amounts of raw data. Many of the AI applications in use today are powered by some form of deep learning.
|
||||
- Other significant subfields and applications under the AI umbrella include **robotics, expert systems, and natural language processing**.
|
||||
|
||||
### Types of AI Based on Capability
|
||||
|
||||
AI systems are often categorised by their level of sophistication and capability:
|
||||
|
||||
- **Narrow AI (ANI) / Weak AI**: This is the most common type of AI currently in existence and wide use. It is specialised in performing a specific task or a limited set of tasks within pre-determined parameters. Examples include virtual assistants like Siri or Amazon Alexa, facial recognition software, and recommendation engines. Even emerging generative AI applications, while powerful, are still considered weak AI because they cannot be repurposed for other domains.
|
||||
- **General AI (AGI) / Strong AI**: This is a hypothetical stage where an AI system would possess human-level intelligence. It would be capable of understanding, learning, and applying knowledge across a wide range of tasks without manual intervention, similar to a human being. AGI remains a theoretical concept and research goal, and true AGI does not currently exist.
|
||||
- **Super AI (ASI) / Artificial Superintelligence**: This theoretical level of AI would vastly surpass human intelligence in all aspects, including scientific creativity, general wisdom, and social skills. While not a prerequisite for AGI, some narrow AI models have already demonstrated "superintelligence" in specific domains by exceeding human performance (e.g., AlphaFold in protein structure prediction, IBM Deep Blue in chess, AlphaGo in Go). However, these are still considered narrow AI as they cannot autonomously learn new tasks or expand their problem-solving capabilities beyond their narrowly defined scope.
|
||||
|
||||
### History and Evolution of AI
|
||||
|
||||
The concept of thinking machines dates back to ancient myths and stories. The formal field of AI research was founded at the **Dartmouth College workshop in 1956**, where the term "artificial intelligence" was coined by John McCarthy. Early research included projects like ELIZA, the first chatbot (1966). Initial optimism led to ambitious predictions, but significant challenges and limited computing power resulted in periods known as "AI winters," marked by reduced funding and interest.
|
||||
|
||||
The field saw renewed interest with the commercial success of "expert systems" in the 1980s and the establishment of deep learning's foundations. More recent breakthroughs include IBM Watson's victory on _Jeopardy!_ (2011) and AlphaGo's defeat of a Go champion (2016). The invention of the **transformer architecture in 2017** proved particularly impactful for language tasks and has enabled the development and public release of powerful generative AI models, such as ChatGPT in 2022, initiating the current "AI boom" and bringing AI into mainstream use.
|
||||
@@ -0,0 +1,88 @@
|
||||
---
|
||||
sidebar_position: 2
|
||||
---
|
||||
|
||||
## The Evolution of Artificial Intelligence: From Myth to Modernity
|
||||
|
||||
:::tip
|
||||
You can listen and follow along with your reading.
|
||||
<audio controls>
|
||||
<source src="/audio/History of AI.wav" type="audio/mpeg" />
|
||||
Your browser does not support the audio element.
|
||||
</audio>
|
||||
:::
|
||||
|
||||
The history of artificial intelligence (AI) stretches back to ancient myths and philosophical concepts of thinking machines, evolving through distinct periods of development, breakthroughs, and challenges, leading to its current impactful presence and speculative future.
|
||||
|
||||
### Ancient and Early Foundations
|
||||
|
||||
The idea of thinking machines dates back to antiquity, with myths, stories, and rumors of artificial beings possessing intelligence or consciousness. Philosophers like Aristotle laid conceptual groundwork for formal reasoning, which is fundamental to AI. By the 19th century, concepts of artificial men and thinking machines became popular themes in fiction, as seen in Mary Shelley's _Frankenstein_ and Karel Čapek's _R.U.R._ (Rossum's Universal Robots). Early automata were also built across civilizations, believed by some to be imbued with real minds.
|
||||
|
||||
### Birth of Modern AI (1940s–1950s)
|
||||
|
||||
The formal field of AI research was founded at the **Dartmouth College workshop in 1956**. Here, the term **"artificial intelligence" was coined by John McCarthy**. The workshop aimed to test the assertion that "every aspect of learning or any other feature of intelligence can be so precisely described that a machine can be made to simulate it".
|
||||
|
||||
Before this, **Alan Turing**, often referred to as the "father of computer science," published his seminal paper "Computing Machinery and Intelligence" in **1950**. In this paper, Turing proposed the **Turing Test**, a game to determine if a machine could carry on a conversation indistinguishable from a human, suggesting that if it could, it would be reasonable to say the machine was "thinking". This test remains an important benchmark for AI progress. Inspired by theories in neurology, cybernetics, and information theory, scientists began to explore the possibility of building an "electronic brain". In **1955**, Allen Newell and Herbert A. Simon created the **Logic Theorist**, considered the first running AI computer program.
|
||||
|
||||
### Early Successes and First AI Winter (1956–1980)
|
||||
|
||||
The period after the Dartmouth Workshop saw significant optimism among AI researchers, who predicted fully intelligent machines within 20 years. Government agencies like the Defense Advanced Research Projects Agency (DARPA) heavily funded AI research, establishing laboratories at universities like MIT, Carnegie Mellon, and Stanford.
|
||||
|
||||
Key developments during this time included:
|
||||
|
||||
- **Symbolic Reasoning**: Early AI programs often used search algorithms to solve problems like proving theorems or playing games. The concept of manipulating symbols as the essence of human thought gained traction.
|
||||
- **Natural Language Processing**: **Joseph Weizenbaum's ELIZA**, the first AI chatbot, was unveiled in **1966**. While rudimentary, it could carry out conversations convincingly enough to fool users into thinking they were communicating with a human.
|
||||
- **Game AI**: Programs like Arthur Samuel's checkers program (1959) demonstrated early machine learning.
|
||||
|
||||
However, by the **1970s**, early enthusiasm faded as the technology failed to meet the ambitious predictions, leading to growing discontent and reduced funding. This period, marked by critiques like the **Lighthill report (1973)** which highlighted the "combinatorial explosion" problem, became known as the **first "AI winter" (1974–1980)**. Challenges included limited computer power, the intractability of problems, **Moravec's paradox** (where AI struggled with "unintelligent" tasks like perception that humans find easy), and the vastness of commonsense knowledge.
|
||||
|
||||
### Boom and Second AI Winter (1980s–2000s)
|
||||
|
||||
Despite the setbacks, AI research continued. The **1980s** saw a resurgence with the adoption of **"expert systems"** by corporations. These systems used logical rules and large databases of specialist knowledge, saving companies millions. Japan's Fifth Generation Computer Project and the U.S. Strategic Computing Initiative further fueled investment, with the AI industry growing to billions of dollars. This period also saw the **revival of neural networks**, referred to as the **"connectionist" approach**, which aimed to replicate the human brain's structure. In **1986, Geoffrey Hinton** popularized **"backpropagation,"** a crucial training technique for neural networks.
|
||||
|
||||
However, the limitations of expert systems led to another period of reduced funding and interest, the **second "AI winter" (1987–1993)**. Many fledgling AI companies went bankrupt. Despite this, AI algorithms continued to develop and were increasingly used **"behind the scenes"** in larger systems for tasks like data mining, speech recognition, and medical diagnosis, often without being explicitly called "AI". The **1990s** also saw milestones like **IBM Deep Blue defeating world chess champion Garry Kasparov in 1997**. A new paradigm of **"intelligent agents"** emerged, defining AI as the study of systems that perceive their environment and take actions to maximize success.
|
||||
|
||||
### Big Data, Deep Learning, and AGI (2005–2017)
|
||||
|
||||
The early 21st century witnessed a **renaissance in AI** due to increased access to **"big data,"** cheaper and faster computers (especially **GPUs**), and advanced machine learning techniques.
|
||||
|
||||
- **Deep Learning Revolution**: This was a breakthrough technology, using **multilayered neural networks (deep neural networks)** to simulate the complex decision-making power of the human brain. Deep learning significantly improved performance in areas like image and video processing, text analysis, and speech recognition.
|
||||
- **Notable Achievements**: **IBM Watson defeated _Jeopardy!_ champions in 2011**. In **2012, AlexNet**, developed by Alex Krizhevsky (a student of Hinton), won the ImageNet computer vision competition by efficiently using GPUs to run deep networks, marking the beginning of the "deep learning era". Google DeepMind's **AlphaGo defeated a world Go champion in 2016**.
|
||||
- **Artificial General Intelligence (AGI)**: Around the mid-2010s, concerns that mainstream AI was too focused on "narrow AI" led to renewed interest and direct research into **Artificial General Intelligence (AGI)**, the hypothetical stage where an AI system could match or exceed human cognitive abilities across any task. Companies like OpenAI and Google's DeepMind were founded with this pursuit.
|
||||
|
||||
### Large Language Models and Current AI Boom (2017–Present)
|
||||
|
||||
A pivotal moment came in **2017** with the invention of the **transformer architecture** by Google researchers. This architecture, which exploits an **attention mechanism**, proved particularly useful for language tasks, enabling AIs to simultaneously handle translation, text generation, and document summarization. Most of today's leading AI models, including generative AI applications, rely on this architecture.
|
||||
|
||||
The current **"AI boom"** was largely initiated by the public release of **Large Language Models (LLMs)** based on the transformer architecture.
|
||||
|
||||
- **ChatGPT Launch**: On **November 30, 2022, OpenAI released ChatGPT**, powered by its GPT-3 model. It rapidly gained over 100 million users in two months, becoming the fastest-growing consumer software application in history. This brought AI into mainstream public consciousness.
|
||||
- **Generative AI (Gen AI)**: LLMs are a type of generative AI that can produce unique and realistic content like text, images, video, and audio from learned knowledge. They train on massive datasets, allowing them to respond to human queries in a human-like manner.
|
||||
- **Current Capabilities**: LLMs are proficient in tasks such as summarization, text generation, creative writing, question answering, and code generation. They can interpret human language even when vague, and associate words and concepts by meaning due to vast training. While powerful, current generative AI applications are still considered **Narrow AI** because they are limited to specific domains and cannot be repurposed for others.
|
||||
|
||||
The rapid adoption of these AI technologies has sparked intense debate regarding ethical implications, including concerns about misinformation (deepfakes) and job displacement. Calls for a pause in advanced AI development have also emerged.
|
||||
|
||||
### Possible Future of AI (Near-term and Long-term)
|
||||
|
||||
Experts predict AI will become a fixture in personal and business lives within the next decade (by 2034).
|
||||
|
||||
**Near-term (2020s–2030s)**:
|
||||
|
||||
- **Multimodal AI**: Systems will integrate text, voice, images, and video to create more intuitive interactions, closely resembling how humans communicate. This could power advanced virtual assistants that understand complex queries and provide tailored responses across various media.
|
||||
- **Democratization of AI**: User-friendly platforms, including no-code and low-code solutions, will enable non-experts to develop custom AI solutions for business, individual tasks, and creative projects. Open-source AI will also foster transparency and innovation.
|
||||
- **Smaller, More Efficient Models**: There's a shift towards developing smaller, more cost-effective models (e.g., mini GPT 4o-mini) that deliver greater precision with fewer resources, making them suitable for embedding in devices like smartphones.
|
||||
- **AI in the C-Suite**: AI decision-making and prediction modeling will advance, allowing AI systems to function as strategic business partners, offering advice and automating complex tasks for executives.
|
||||
- **Regulations and Ethics**: Ethical considerations will shape regulations, including bans on systems posing unacceptable risks, with a focus on human oversight, fundamental rights, bias, and fairness.
|
||||
- **Agentic AI**: Systems composed of specialized agents that proactively anticipate needs and make autonomous decisions will become a core part of personal and business life. These agents adapt to real-time environments, use simpler decision-making algorithms, and learn from feedback.
|
||||
- **Synthetic Data**: As human-generated data becomes scarcer, artificial datasets that mimic real-world patterns will become standard for training AI, enhancing model accuracy and promoting data diversity.
|
||||
- **Hallucination Insurance**: Companies might offer "AI hallucination insurance" to protect against incorrect or misleading AI outputs, particularly in critical sectors like finance, medicine, and law.
|
||||
|
||||
**Long-term and "Moonshots"**:
|
||||
|
||||
- **Artificial General Intelligence (AGI)**: While speculative, the emergence of AGI by 2034 could lead to AI systems that autonomously generate, curate, and refine their own training datasets, enabling self-improvement without human intervention. True AGI does not currently exist and remains a theoretical concept and research goal.
|
||||
- **Post-Moore Computing**: Innovations in **neuromorphic computing** (mimicking the brain) and **optical computing** (using light) aim to move beyond traditional computing limits, potentially drastically reducing the time and resources needed to train and run large AI models.
|
||||
- **Distributed "Internet of AI"**: This envisions a decentralized AI infrastructure where AI operates across multiple devices and locations, processing data locally to enhance privacy and reduce latency.
|
||||
- **Overcoming Transformer Limitations**: Research is ongoing to improve the computational efficiency of transformer models, allowing them to handle larger context windows without exponential increases in resource usage, leading to more coherent and contextually relevant responses.
|
||||
- **Beyond Binary (Bitnet Models)**: Using ternary parameters (base-3) instead of binary data could enable AI to process information more efficiently, leading to faster computations and less power consumption.
|
||||
|
||||
The history of AI is marked by alternating periods of optimism and skepticism, but its current trajectory points toward increasing influence across all sectors of society, with ongoing breakthroughs and new challenges on the horizon.
|
||||
@@ -0,0 +1,64 @@
|
||||
---
|
||||
sidebar_position: 3
|
||||
---
|
||||
|
||||
## Understanding AI: Types and Capabilities
|
||||
|
||||
:::tip
|
||||
You can listen and follow along with your reading.
|
||||
<audio controls>
|
||||
<source src="/audio/Levels of AI.wav" type="audio/mpeg" />
|
||||
Your browser does not support the audio element.
|
||||
</audio>
|
||||
:::
|
||||
|
||||
|
||||
Artificial intelligence (AI) can be described across **different levels or types**, reflecting its capabilities and how it processes information. The sources provide two main frameworks for categorising AI: **capability-based levels** and **functionality-based levels**.
|
||||
|
||||
### Capability-Based Levels
|
||||
|
||||
This framework categorises AI into three main types based on their intelligence levels relative to human capabilities:
|
||||
|
||||
1. **Artificial Narrow Intelligence (ANI) / Weak AI**
|
||||
|
||||
- **Description**: ANI, also known as weak AI, is the most common type of AI found today. These systems are **specialized in a single task or domain** and cannot perform tasks outside their pre-programmed scope. Their "intelligence" is demonstrated only within these specific areas. Even emerging generative AI applications, despite their advancements, are considered weak AI because they cannot be repurposed for other domains.
|
||||
- **Capabilities**: ANI systems are limited to computing specifications, algorithms, and the specific tasks they are designed for. They may have limited memories and rely only on real-time data to make decisions. They require substantial training with specific datasets to work reliably with unfamiliar data within their domain.
|
||||
- **Examples**: Facial recognition software, AI summarizers, Google Search, predictive analytics, virtual assistants like Amazon Alexa, Apple Siri, or Google Assistant, and self-driving automobiles. IBM's Deep Blue, which defeated world chess champion Garry Kasparov in 1997, is also an example of a reactive machine, a form of narrow AI.
|
||||
2. **Artificial General Intelligence (AGI) / Strong AI**
|
||||
|
||||
- **Description**: AGI, also referred to as strong AI or general AI, is a **hypothetical stage** in AI development. The aim of AGI research is to create software with human-like intelligence and the **ability to self-teach**, enabling it to perform tasks it was not specifically trained or developed for. It represents the fundamental goal of AI development: the artificial replication of human intelligence in a machine or software. AGI can solve complex problems in various domains, like a human being, without manual intervention.
|
||||
- **Key Distinctions**: Unlike current AI that requires substantial training for related tasks within the same domain (e.g., fine-tuning an LLM with medical datasets to become a medical chatbot), an AGI system could learn and handle unfamiliar tasks without additional training. Strong AI, a concept often conflated with AGI, specifically refers to an AI system demonstrating consciousness and is considered a conscious mind, rather than merely a tool. Consciousness is usually implied as either a prerequisite or consequence of general intelligence.
|
||||
- **Challenges in Research**: Achieving AGI is a **distant goal** and poses significant challenges. These include limited computer power, the intractability of problems leading to "combinatorial explosion" (where finding optimal solutions requires extraordinary computer time), and Moravec's paradox (where AI excels at "intelligent" tasks but struggles with "unintelligent" tasks like perception). It also requires overcoming the vastness of commonsense knowledge and representing commonsense reasoning, which is difficult to formalize with precise definitions. Furthermore, current neural networks struggle to replicate authentic human creativity and emotional thinking. AGI systems would also need to physically interact with the external environment and perceive the world as humans do, requiring advancements beyond existing computer technologies.
|
||||
- **Theoretical Approaches**: AI experts have proposed several methods for AGI research:
|
||||
- **Symbolic approach**: Assumes AGI can be developed by representing human thoughts with expanding logic networks, using if-else logic to interpret ideas at a higher thinking level. However, it struggles with lower-level cognitive abilities like perception.
|
||||
- **Connectionist (or emergentist) approach**: Focuses on replicating the human brain's structure with neural-network architecture, hoping to achieve human-like and low-level cognitive capabilities by mimicking how brain neurons alter transmission paths based on external stimuli. Large language models (LLMs) are an example of AI using this method.
|
||||
- **Universalists**: While not detailed in the provided sources, this suggests a broader, more integrated approach (implied by).
|
||||
- **Technological Drivers**: Deep learning, generative AI, natural language processing (NLP), computer vision, and robotics are considered emerging technologies driving AGI research.
|
||||
- **Current Status**: AGI remains a theoretical concept and research goal. No known AI systems currently approach this level of sophistication. However, some researchers have argued that advanced LLMs like GPT-4 could reasonably be viewed as an early, incomplete version of an AGI system, given their ability to solve novel and difficult tasks across various domains.
|
||||
3. **Artificial Superintelligence (ASI)**
|
||||
|
||||
- **Description**: ASI is a **theoretical AI system** whose capabilities vastly exceed those of human beings. It surpasses human intelligence in all aspects, including creativity, problem-solving, and emotional intelligence.
|
||||
- **Current Status**: ASI is still largely theoretical and a topic of debate and speculation. While true general superintelligence has not been achieved, there are narrow AI models that demonstrate what could be fairly called superintelligence in their specific tasks, as they exceed human performance.
|
||||
- **Examples of "Narrow Superintelligence"**: AlphaFold (predicts protein structures better than humans), IBM Deep Blue (defeated world chess champion Garry Kasparov in 1997), IBM Watson (defeated _Jeopardy!_ champions in 2013), and AlphaGo (considered the world's greatest Go player). However, these models have not achieved artificial "general" intelligence as they cannot autonomously learn new tasks or expand their problem-solving capabilities beyond their narrowly defined scope.
|
||||
|
||||
### Functionality-Based Levels
|
||||
|
||||
This framework categorises AI based on how machines process information and react to stimuli, reflecting stages of AI development:
|
||||
|
||||
1. **Reactive Machines**
|
||||
|
||||
- **Description**: This is a limited form of AI that **only reacts to different kinds of stimuli based on pre-programmed rules**. It does not use memory and, therefore, cannot learn with new data.
|
||||
- **Examples**: IBM's Deep Blue, which beat chess champion Garry Kasparov in 1997, is an example of a reactive machine. Spam filters are also mentioned as an example.
|
||||
2. **Limited Memory**
|
||||
|
||||
- **Description**: Most modern AI systems fall into this category. They can **use memory to improve over time by being trained with new data**, typically through an artificial neural network or other training model. This capability allows them to use past data for a short period to inform decisions.
|
||||
- **Connection to Modern AI**: Deep learning, a subset of machine learning, is considered limited memory AI. This type of AI learns and improves through exposure to vast amounts of data, identifying patterns and relationships that humans may miss.
|
||||
- **Examples**: Self-driving cars (which consider recent past observations to navigate) and chatbots are examples of limited memory AI. Recommendation engines also fit this category.
|
||||
3. **Theory of Mind**
|
||||
|
||||
- **Description**: Theory of mind AI describes AI that **does not currently exist**, but research is ongoing into its possibilities. It would be able to **emulate the human mind's decision-making capabilities**, including recognising and remembering emotions and reacting in social situations as a human would.
|
||||
4. **Self-Aware**
|
||||
|
||||
- **Description**: A step above theory of mind AI, self-aware AI describes a **mythical machine** that is aware of its own existence and has the intellectual and emotional capabilities of a human. Like theory of mind AI, **self-aware AI does not currently exist** and remains purely hypothetical.
|
||||
|
||||
In summary, while most existing AI is "narrow" and operates at the reactive or limited memory levels, Artificial General Intelligence, Artificial Superintelligence, Theory of Mind AI, and Self-Aware AI remain theoretical concepts and are subjects of ongoing research and speculation.
|
||||
@@ -0,0 +1,94 @@
|
||||
---
|
||||
sidebar_position: 4
|
||||
---
|
||||
|
||||
## Machine Learning: Concepts, Types, and Applications
|
||||
|
||||
:::tip
|
||||
You can listen and follow along with your reading.
|
||||
<audio controls>
|
||||
<source src="/audio/Machine Learning.wav" type="audio/mpeg" />
|
||||
Your browser does not support the audio element.
|
||||
</audio>
|
||||
:::
|
||||
|
||||
**Machine learning (ML)** is a **subset of artificial intelligence (AI)** that focuses on enabling computers and machines to **learn from data and improve their performance on specific tasks without being explicitly programmed for every scenario**. Instead of following fixed, explicit instructions, ML systems use algorithms to **analyse large volumes of data, identify patterns, and then make predictions or decisions based on what they learn**.
|
||||
|
||||
### How Machine Learning Works
|
||||
|
||||
At its essence, the core principle of AI, including ML, revolves around data. ML models are "trained" by being exposed to vast amounts of data. During this **training phase**, algorithms—which are sets of rules or instructions—guide the AI's analysis and decision-making. The machine "learns" by adjusting its **internal parameters**, such as weights and biases in mathematical functions, to **minimise errors** between its predictions and the actual outcomes. This **iterative process** of evaluation and optimisation allows the model to continuously refine its understanding and become more accurate over time.
|
||||
|
||||
Once a model is properly trained, it can then perform **inference**, which is the process of using the trained model to draw conclusions, make predictions, or generate outputs from **new, unseen data**. For example, a machine learning model trained on historical sports performance data could predict a player's future performance, or a self-driving car could recognise a stop sign on an unfamiliar road.
|
||||
|
||||
### Relationship to Artificial Intelligence and Deep Learning
|
||||
|
||||
ML is a **core discipline within the broader field of AI**. AI is the overarching concept of enabling machines to simulate human intelligence to solve problems. ML is a **specific application of AI** that allows machines to extract knowledge from data and learn autonomously.
|
||||
|
||||
**Deep learning (DL)** is, in turn, a **subset of machine learning**. DL uses **multi-layered artificial neural networks** (also known as deep neural networks) to simulate the complex decision-making power of the human brain. The "deep" refers to the presence of three or more hidden layers between the input and output layers, which can number in the hundreds or even thousands. This architecture enables DL models to automatically learn complex patterns and hierarchical representations directly from **large amounts of raw, unstructured data** without human intervention in feature engineering. Most of the AI applications we interact with today are powered by some form of deep learning.
|
||||
|
||||
### Types of Machine Learning
|
||||
|
||||
Machine learning models primarily fall into three categories based on their learning approach:
|
||||
|
||||
- **Supervised Learning**: This is the **most common type** and involves training algorithms on **labelled datasets** (structured data) where the correct output for each input is known. The model learns to map specific inputs to desired outputs. An example is feeding an algorithm pictures labelled as "cats" to train it to recognise cats. Supervised learning underpins most state-of-the-art AI models today and is primary for tasks requiring accuracy like classification or regression.
|
||||
- **Unsupervised Learning**: This approach uses **unlabelled data** (unstructured data) to discover hidden patterns, relationships, or groupings within the data without pre-defined outputs. It is particularly effective for tasks like pattern matching, descriptive modelling, and customer segmentation.
|
||||
- **Reinforcement Learning**: In this "learn by doing" model, an "agent" learns to perform a defined task through **trial and error**. It receives positive "rewards" for good performance and negative "penalties" for poor performance, continuously adjusting its actions to maximise the reward. IBM Watson's victory on _Jeopardy!_ in 2011 is a good example of reinforcement learning.
|
||||
- **Semi-supervised Learning**: This is a mixed approach that uses a **smaller labelled dataset to guide classification and feature extraction from a larger, unlabelled dataset**. It helps when there isn't enough labelled data for pure supervised learning or when labelling is too costly.
|
||||
|
||||
### Common Machine Learning Algorithms/Models
|
||||
|
||||
ML uses various algorithms and model architectures. Neural networks, modeled after the human brain, are a popular type of ML algorithm. Other common algorithms include:
|
||||
|
||||
- **Linear Regression**: Predicts numerical values based on linear relationships.
|
||||
- **Logistic Regression**: Predicts for categorical response variables (e.g., "yes/no").
|
||||
- **Decision Trees**: Used for both numerical predictions and classification, represented by a branching sequence of decisions.
|
||||
- **Random Forests**: Combines results from multiple decision trees for predictions.
|
||||
- **Clustering (e.g., K-means)**: Identifies patterns in data to group them.
|
||||
- **Support Vector Machines (SVMs)**: Used for classification and regression tasks.
|
||||
- **Naive Bayes**: A probabilistic classifier based on Bayes' theorem.
|
||||
|
||||
Deep learning further specialises in neural network architectures, including:
|
||||
|
||||
- **Feedforward Neural Networks (FFNN)**: Data flows one way through layers.
|
||||
- **Recurrent Neural Networks (RNN) and Long Short-Term Memory (LSTM)**: Designed for sequential data, maintaining "memory" of previous inputs.
|
||||
- **Convolutional Neural Networks (CNN)**: Most common for image recognition, using distinct layers to filter image parts.
|
||||
- **Generative Adversarial Networks (GAN)**: Involve two competing neural networks (generator and discriminator) to create realistic output.
|
||||
- **Transformers**: Powerful for processing sequences, foundational for modern Large Language Models (LLMs).
|
||||
|
||||
### Benefits of Machine Learning
|
||||
|
||||
Machine learning offers significant benefits to organisations, particularly in handling large and complex datasets:
|
||||
|
||||
- **Automation**: Automates tasks and workflows that previously required human intervention.
|
||||
- **Actionable Insights**: Identifies patterns and trends in massive volumes of data that humans might miss, enabling data-driven decision-making.
|
||||
- **Predictive Capabilities**: Enables accurate predictions and forecasting across various domains.
|
||||
- **Efficiency and Productivity**: Streamlines processes and improves productivity.
|
||||
- **Personalisation**: Provides personalised experiences for users as models learn from individual interactions.
|
||||
- **Accessibility**: Pre-trained models and modular platforms make ML more accessible to a wider range of users and businesses.
|
||||
|
||||
### Applications of Machine Learning
|
||||
|
||||
ML is widely applied across numerous industries and everyday technologies:
|
||||
|
||||
- **Speech Recognition**: Converts spoken language into text, used in virtual assistants like Siri and Alexa.
|
||||
- **Image Recognition and Computer Vision**: Identifies and categorises aspects of images and videos, used in facial recognition, self-driving cars, and medical image analysis.
|
||||
- **Natural Language Processing (NLP)**: Trains computers to understand, interpret, and generate human language, powering chatbots, summarisers, and translation services.
|
||||
- **Generative AI**: Creates original content like text, images, video, and code in response to user prompts, leveraging deep learning models.
|
||||
- **Recommendation Systems**: Suggests products, content, or services based on past behaviour and preferences.
|
||||
- **Fraud Detection**: Analyses transaction patterns to flag anomalies indicative of fraud.
|
||||
- **Predictive Maintenance**: Forecasts equipment failures using sensor data.
|
||||
- **Healthcare**: Analyses patient records, aids in diagnostics, and accelerates drug development.
|
||||
- **Cybersecurity**: Continuously monitors and analyses network traffic to detect threats.
|
||||
- **Financial Services**: Used for algorithmic trading and assessing business risks.
|
||||
- **Robotics**: Enables robots to learn new tasks through observation and feedback.
|
||||
|
||||
### Challenges and Limitations
|
||||
|
||||
Despite its advancements, machine learning faces several challenges:
|
||||
|
||||
- **Data Requirements**: ML, especially deep learning, requires **vast amounts of high-quality, accurate, and unbiased training data**. "Garbage in, garbage out" is a key concern.
|
||||
- **Computational Resources**: Training complex models, particularly deep neural networks, demands **significant computing power**, often requiring high-performance GPUs and considerable energy.
|
||||
- **Interpretability ("Black Box" Problem)**: Many complex ML and deep learning models are often considered "black boxes," making it **difficult to understand _why_ they make specific decisions** or how their inner workings lead to a particular output.
|
||||
- **Bias and Unintended Outcomes**: Since models are trained by humans on human-generated data, they can **inherit and perpetuate human biases and existing inequities**, leading to discriminatory or problematic outputs.
|
||||
- **Accuracy Limitations**: While highly accurate, ML models are not always perfect, and their level of acceptable accuracy depends on the application. For critical tasks like self-driving cars or medical diagnostics, very high accuracy is required.
|
||||
- **Technological Singularity**: While not an immediate concern for most researchers, the theoretical idea of **AI surpassing human intelligence** (often termed strong AI or superintelligence) raises ethical and societal questions.
|
||||
@@ -0,0 +1,6 @@
|
||||
{
|
||||
"position": 1,
|
||||
"link": {
|
||||
"type": "generated-index"
|
||||
}
|
||||
}
|
||||
Reference in new issue
Block a user