Autor: Roque E. de Campos

Emergence, Dasein, To be or not to be and Material Constitution

/ Roque E. de Campos / Deixe um comentário

The title of this post encompasses four takes on one aspect of “being” that to me are related, and the purpose of this post is that hopefully will help to understand what is at stake.

It is very important to realize that all these takes are points of view. The aim of point of view varies with each context, but generally, it is about providing a specific perspective from which a story, argument, or observation is made or understood. They all collide head on with reality, which I post separately

What sparked my idea was the discussion about why computers do not think and the discussion was under “What is consciousness“, specially “the hard problem”.

Perhaps through a rather long kind of introduction, examining the two most spread approaches on “being”, i.e. scholasticism and humanism, which will be detailed and the kind of shake down Heidegger did to them with his approach, will work as a frame to understand how emergence, shakespeare and material constitution has to do with it.

The discussion of “being”, in that post, (“What is consciousness“, specially “the hard problem”) is done from the point of view of our brain or what makes it possible to happen physically and here I want to add how this is discussed and considered from the point of view of, how do I say it, psychologically, or rather intellectually, under several schools of thought. I will privilege it philosophically or under the most commonly accepted philosophers who dedicated themselves to that.

Heidegger will be the philosophical reference and Encyclopaedia Britannica tells us that his groundbreaking work in ontology (the philosophical study of being, or existence) and metaphysics determined the course of 20th-century philosophy on the European continent and exerted an enormous influence on virtually every other humanistic discipline, including literary criticism, hermeneutics, psychology, and theology.

Heidegger’s philosophy presents a significant shift from previous philosophical traditions. He critiques and reinterprets the ideas of Descartes, Kant, Hegel, Nietzsche, Husserl, and Aristotle, among others, to develop a new understanding of being. Heidegger’s focus on Dasein as “being-in-the-world,” his critique of traditional metaphysics, and his emphasis on existential and temporal aspects of human life represent a radical departure from classical and modern philosophical frameworks.

Heidegger’s Concept of Dasein

Dasein, a key concept in Martin Heidegger’s philosophy, is central to his magnum opus, “Being and Time” (Sein und Zeit). Heidegger uses Dasein to refer to the unique mode of being that characterizes human existence. Here’s a breakdown of what Heidegger meant by Dasein:

Key Aspects of Dasein

  1. Being-there:
    • The term Dasein is a German word that translates roughly to “being-there” or “existence.” Heidegger chose this term to emphasize that human beings are not just present in the world as objects among other objects but have a unique way of being that involves awareness and engagement with their surroundings.
    • Dasein is distinguished by its capacity to reflect on its own existence and the nature of being itself.
    • Sources: Stanford Encyclopedia of Philosophy – Heidegger, Internet Encyclopedia of Philosophy – Heidegger
  2. Existential Structure:
    • Dasein is not a static entity but is characterized by its potentialities and possibilities. It is always in a state of “being-ahead-of-itself,” constantly projecting itself into the future and shaping its own existence through choices and actions.
    • This notion contrasts with traditional metaphysical views that see existence as a static state or predefined essence.
    • Sources: Encyclopaedia Britannica – Dasein, Heidegger’s “Being and Time”
  3. Being-in-the-world:
  4. Authenticity and Inauthenticity:
    • Heidegger explores how Dasein can exist authentically or inauthentically. Authenticity involves recognizing and embracing one’s own unique potential and living in accordance with one’s true self.
    • In contrast, inauthenticity involves conforming to the expectations and norms of others, losing one’s individuality in the process.
    • This dichotomy highlights the importance of personal responsibility and the pursuit of a genuine and meaningful existence.
    • Sources: Stanford Encyclopedia of Philosophy – Authenticity, Routledge Encyclopedia of Philosophy – Heidegger
  5. Being-toward-death:
    • Heidegger argues that awareness of death is a fundamental aspect of Dasein. Recognizing the inevitability of death helps Dasein understand the finite nature of existence and motivates authentic living.
    • This concept of “being-toward-death” (Sein-zum-Tode) encourages individuals to confront their mortality and live in a way that reflects their true values and aspirations.
    • Sources: Heidegger’s “Being and Time”, Internet Encyclopedia of Philosophy – Being-toward-Death

Summary

Heidegger’s concept of Dasein represents a fundamental shift in thinking about human existence. It emphasizes the uniqueness of human beings as entities that are inherently aware of and capable of reflecting on their own existence. Dasein’s nature is characterized by its possibilities, its embeddedness in the world, and its constant engagement with the question of what it means to exist authentically. This concept has had a profound impact on existential philosophy and continues to influence contemporary thought on human existence.

Key Philosophers Heidegger Engages With

Martin Heidegger’s philosophy, particularly as presented in “Being and Time,” critiques and diverges from the ideas of several key philosophers, proposing a new way of thinking about existence, being, and human nature. Here’s an analysis of the philosophers whose ideas Heidegger challenges or seeks to replace:

  1. René Descartes:
    • Dualism and Subjectivity: Descartes is known for his dualistic approach, separating mind and body and emphasizing the cogito (“I think, therefore I am”) as the foundation of knowledge. Heidegger challenges this separation, arguing that being cannot be understood merely as a thinking subject separate from the world. Instead, he proposes the concept of Dasein as “being-in-the-world,” where existence is characterized by its interactions and relationships with the surrounding environment​ .
    • Objectification of Being: Descartes’ view treats being as an object of scientific study, something that can be dissected and understood through rational thought. Heidegger opposes this, suggesting that such an approach overlooks the fundamental question of what it means to be​
  2. Immanuel Kant:
    • Epistemology and Transcendental Idealism: Kant’s philosophy focuses on how we can know things and the structures that underlie our perception and understanding of the world. Heidegger critiques Kant for reducing being to the structures of human cognition, thereby neglecting the deeper, more fundamental aspects of existence . Heidegger’s ontological focus attempts to go beyond Kantian epistemology to explore the nature of being itself.
    • Time and Temporality: Kant treats time as a mere condition for human experience. Heidegger, on the other hand, emphasizes the existential significance of time, proposing that understanding our own temporality is crucial for grasping the essence of being .
  3. G.W.F. Hegel:
    • Absolute Idealism: Hegel’s philosophy presents a dialectical process where reality is seen as a development towards an absolute, rational self-consciousness. Heidegger critiques Hegel’s abstraction and his concept of a totalizing Absolute, arguing that it overlooks the concrete, everyday experience of being . Heidegger focuses on individual existence and the lived experience rather than a grand historical process.
    • Historical Determinism: While Hegel emphasizes the unfolding of spirit through historical processes, Heidegger rejects the notion that history progresses towards a specific end. For Heidegger,history is not a deterministic path but a series of open-ended possibilities for Dasein.
  4. Friedrich Nietzsche:
    • Nihilism and the Will to Power: Nietzsche’s critique of traditional metaphysics and his concept of the will to power significantly influence Heidegger. However, Heidegger believes Nietzsche’s approach ultimately falls into the same metaphysical trap by replacing a transcendent being with a focus on power dynamics. Heidegger seeks to move beyond Nietzsche’s nihilism by rethinking the question of being itself, without reducing it to human will or power .
    • Overcoming Metaphysics: Heidegger shares Nietzsche’s desire to overcome traditional metaphysics, but he does so by reinterpreting the meaning of being rather than abandoning the concept of being entirely as Nietzsche suggests .
  5. Edmund Husserl:
    • Phenomenology and Intentionality: As the founder of phenomenology, Husserl emphasizes the intentional structure of consciousness and its role in constituting meaning. Heidegger diverges from Husserl by arguing that phenomenology should focus not just on consciousness but on the structures of being itself. He develops hermeneutic phenomenology, which interprets the meaning of being in the context of human existence rather than purely in terms of consciousness and intentionality .
    • Reductionism: Husserl’s method involves bracketing or suspending the natural attitude to focus purely on consciousness. Heidegger argues that this approach is too abstract and fails to account for the existential realities of human life. Heidegger’s approach seeks to uncover the pre-theoretical conditions of being .
  6. Aristotle:
    • Being as Presence: Aristotle’s metaphysics views being primarily in terms of substance and presence. Heidegger respects Aristotle but critiques his focus on being as something that is present-at-hand, arguing instead for a more dynamic understanding of being that encompasses potentiality and temporality . Heidegger seeks to revive a pre-Socratic sense of being that is not confined to static categories.
    • Ontological Difference: Heidegger develops the concept of the ontological difference, distinguishing between being (Sein) and beings (Seiende), which he believes Aristotle did not fully articulate .

Conclusion

Heidegger’s philosophy presents a significant shift from previous philosophical traditions. He critiques and reinterprets the ideas of Descartes, Kant, Hegel, Nietzsche, Husserl, and Aristotle, among others, to develop a new understanding of being. Heidegger’s focus on Dasein as “being-in-the-world,” his critique of traditional metaphysics, and his emphasis on existential and temporal aspects of human life represent a radical departure from classical and modern philosophical frameworks.

Heidegger’s Influence on Existentialism

Martin Heidegger is widely recognized as a key precursor to existentialism, although he himself did not align strictly with the existentialist label. His philosophical ideas, especially as articulated in “Being and Time” (Sein und Zeit), had a profound influence on the existentialist movement and its central themes. Here’s how Heidegger’s work laid the groundwork for existentialism:

Core Contributions to Existentialism

  1. Focus on Existence and Being:
    • Existence Precedes Essence: Heidegger’s exploration of Dasein, or “being-there,” emphasizes the primacy of existence over essence, a theme that became central to existentialism. Existentialists argue that individuals must create their own meaning and essence through their actions and choices.
    • Heidegger’s view that human beings are defined not by a predetermined essence but by their potential to define themselves through choices and actions resonates with existentialist themes.
    • Sources: Stanford Encyclopedia of Philosophy – Existentialism, Internet Encyclopedia of Philosophy – Existentialism
  2. Authenticity and Inauthenticity:
    • Heidegger’s distinction between authentic and inauthentic existence influenced existentialists like Jean-Paul Sartre and Albert Camus. Authenticity involves embracing one’s freedom and potential, while inauthenticity involves conforming to societal norms and expectations.
    • This concept emphasizes the importance of individual responsibility and the need to live a life that is true to oneself, free from external impositions.
    • Sources: Routledge Encyclopedia of Philosophy – Authenticity, Encyclopaedia Britannica – Heidegger
  3. Being-in-the-World:
    • Heidegger’s notion of Being-in-the-world (In-der-Welt-sein) emphasizes that human existence is fundamentally relational and embedded in a context of interactions with others and the environment. This idea challenges the Cartesian separation of mind and body and underscores the interconnectedness of individual and world, a theme explored deeply in existentialist philosophy.
    • Existentialists, especially Sartre, expand on this idea to explore how individuals define themselves through their interactions with the world and others.
    • Sources: Stanford Encyclopedia of Philosophy – Heidegger’s Works, Cambridge University Press – Being-in-the-World
  4. Being-toward-Death:
    • Heidegger’s concept of Being-toward-death (Sein-zum-Tode) asserts that awareness of mortality is crucial for authentic existence. This notion influenced existentialist themes of finitude, freedom, and the urgency of living a meaningful life in the face of inevitable death.
    • Existentialists like Heidegger argue that confronting mortality leads to a deeper understanding of life and a more genuine approach to existence.
    • Sources: Heidegger’s “Being and Time”, Internet Encyclopedia of Philosophy – Being-toward-Death

Influence on Key Existentialist Thinkers

  1. Jean-Paul Sartre:
    • Sartre’s existentialism, particularly in works like “Being and Nothingness” (L’être et le néant), draws heavily on Heidegger’s ideas. Sartre’s concept of “being-for-itself” and the emphasis on human freedom and responsibility are directly influenced by Heidegger’s Dasein and authenticity.
    • Sartre expands on Heidegger’s ideas by focusing on the radical freedom of individuals to define their own existence and the burden of responsibility that comes with this freedom.
    • Sources: Stanford Encyclopedia of Philosophy – Sartre, Internet Encyclopedia of Philosophy – Sartre
  2. Simone de Beauvoir:
    De Beauvoir’s work, including “The Second Sex” (Le Deuxième Sexe), reflects Heidegger’s influence, particularly in her exploration of the lived experience and the dynamics of freedom and oppression.
    She applies existentialist concepts to issues of gender and identity, examining how societal structures influence individual existence and freedom.
    Sources: Encyclopedia Britannica – Simone de Beauvoir, Stanford Encyclopedia of Philosophy – Beauvoir
  3. Albert Camus:
    Although Camus rejected the existentialist label, his work is often associated with existentialism. His focus on the absurd and the quest for meaning in a seemingly indifferent universe parallels Heidegger’s themes of existential anxiety and the search for authentic being.
    Camus’s concept of the “absurd hero” reflects a Heideggerian engagement with the existential conditions of human life.
    Sources: Stanford Encyclopedia of Philosophy – Camus, Internet Encyclopedia of Philosophy – Camus
    Heidegger’s Distinction from Existentialism
  4. Ontology vs. Existentialism:
    While existentialism focuses on individual existence and personal freedom, Heidegger’s work is more concerned with ontology, the study of being itself. He sought to uncover the fundamental structures of existence that underlie individual experiences.
    Heidegger distanced himself from existentialism, particularly from the more humanistic and individualistic interpretations of thinkers like Sartre.
    Sources: Encyclopaedia Britannica – Existentialism, Cambridge University Press – Heidegger and Existentialism
  5. Critique of Humanism:
    Heidegger criticized the humanism that underlies much of existentialist thought, arguing that it remains trapped in a metaphysical framework that fails to adequately address the question of being.
    He proposed a return to the pre-Socratic understanding of being that transcends human-centered perspectives.
    Sources: Stanford Encyclopedia of Philosophy – Heidegger and Humanism, Heidegger’s “Letter on Humanism”

Heidegger’s Distinction from Existentialism

  1. Ontology vs. Existentialism:
    While existentialism focuses on individual existence and personal freedom, Heidegger’s work is more concerned with ontology, the study of being itself. He sought to uncover the fundamental structures of existence that underlie individual experiences.
    Heidegger distanced himself from existentialism, particularly from the more humanistic and individualistic interpretations of thinkers like Sartre.
    Sources: Encyclopaedia Britannica – Existentialism, Cambridge University Press – Heidegger and Existentialism
  2. Critique of Humanism:
    Heidegger criticized the humanism that underlies much of existentialist thought, arguing that it remains trapped in a metaphysical framework that fails to adequately address the question of being.
    He proposed a return to the pre-Socratic understanding of being that transcends human-centered perspectives.
    Sources: Stanford Encyclopedia of Philosophy – Heidegger and Humanism, Heidegger’s “Letter on Humanism”

Conclusion

Heidegger’s ideas, particularly his concepts of Dasein, authenticity, and being-in-the-world, significantly influenced existentialist thought. His philosophical explorations of being and existence provided a foundational framework that existentialist thinkers expanded upon to explore themes of freedom, individuality, and the search for meaning in a complex and often indifferent world. While Heidegger himself did not identify with existentialism, his work remains a crucial precursor and influence on the movement.

Scholasticism and Humanism

Scholasticism and Humanism have played pivotal roles in shaping Western intellectual history. Scholasticism’s methodical approach to integrating faith and reason contrasts with Humanism’s celebration of human potential and classical learning. Understanding these movements helps illuminate the evolution of thought from the Middle Ages through the Renaissance and beyond.

Heidegger’s philosophy represents a “third way” by diverging from both scholasticism and humanism and introducing a new framework for understanding existence. His focus on existential phenomenology and the ontological question of Being provides a unique perspective that challenges the established traditions of his time.

Timeline of Scholasticism and Humanism

Both Scholasticism and Humanism represent critical intellectual movements in Western history, each associated with significant philosophical, theological, and cultural developments. Here’s a timeline detailing the key periods and events for each:

Scholasticism

1. Early Scholasticism (9th – 12th Century):

  • 9th Century: The Carolingian Renaissance saw the first inklings of Scholastic thought, as scholars such as John Scotus Eriugena began to integrate classical philosophy with Christian theology.
  • 11th Century: The establishment of medieval universities (e.g., University of Bologna) provided institutional support for Scholastic thought. Key figures like Anselm of Canterbury developed arguments for God’s existence, integrating reason with faith.

2. High Scholasticism (12th – 14th Century):

  • 12th Century: The works of Aristotle were reintroduced to Western Europe through translations from Arabic and Greek. Peter Abelard‘s use of dialectical reasoning laid the groundwork for later Scholastic methods.
  • 13th Century: The peak of Scholasticism with Thomas Aquinas, who synthesized Aristotelian philosophy with Christian doctrine in his “Summa Theologica” (c. 1265-1274). Aquinas’ work became a cornerstone of Scholastic thought.

3. Late Scholasticism (14th – 16th Century):

4. Decline and Influence (16th Century – Present):

  • 16th Century: The Protestant Reformation and the rise of Humanism challenged the dominance of Scholastic thought. However, it continued to influence Catholic education and theology, especially in institutions like the Jesuit colleges.
  • 20th Century: Neo-Scholasticism emerged, especially within Catholic intellectual circles, as a revival and modernization of Scholastic principles to address contemporary issues.

Humanism

1. Proto-Humanism and Early Developments (14th Century):

2. Italian Renaissance Humanism (15th Century):

3. Northern Renaissance and Reformation Humanism (16th Century):

4. Decline and Transformation (17th Century – Present):

  • 17th Century: The rise of the scientific revolution shifted intellectual focus away from classical humanism towards empirical science and rationalism.
  • 19th-20th Century: Humanism evolved into various forms, including secular humanism, which emphasizes reason, ethics, and justice while rejecting supernatural and religious beliefs as the basis for moral decision-making.

Key Differences in Their Timelines

  • Origins and Peak: Scholasticism originates in the early medieval period (9th century) and peaks in the 13th century with Thomas Aquinas. Humanism, however, emerges in the late medieval period (14th century) and peaks during the Renaissance (15th-16th centuries).
  • Decline and Legacy: Scholasticism declines with the advent of the Renaissance and the Reformation, while Humanism transitions into new forms such as the Enlightenment and secular humanism.

Conclusion

Scholasticism and Humanism mark two significant epochs in Western intellectual history. Scholasticism’s rigorous dialectical method sought to reconcile faith and reason during the medieval period. In contrast, Humanism’s focus on classical antiquity and human potential reshaped intellectual life during the Renaissance and beyond. Both movements have left a lasting impact on philosophy, education, and culture.

Key Philosophers Heidegger Engages With

Martin Heidegger’s philosophy, particularly as presented in “Being and Time,” critiques and diverges from the ideas of several key philosophers, proposing a new way of thinking about existence, being, and human nature. Here’s an analysis of the philosophers whose ideas Heidegger challenges or seeks to replace:

  1. René Descartes:
    • Dualism and Subjectivity: Descartes is known for his dualistic approach, separating mind and body and emphasizing the cogito (“I think, therefore I am”) as the foundation of knowledge. Heidegger challenges this separation, arguing that being cannot be understood merely as a thinking subject separate from the world. Instead, he proposes the concept of Dasein as “being-in-the-world,” where existence is characterized by its interactions and relationships with the surrounding environment​​ .
    • Objectification of Being: Descartes’ view treats being as an object of scientific study, something that can be dissected and understood through rational thought. Heidegger opposes this, suggesting that such an approach overlooks the fundamental question of what it means to be​.
  2. Immanuel Kant:
    • Epistemology and Transcendental Idealism: Kant’s philosophy focuses on how we can know things and the structures that underlie our perception and understanding of the world. Heidegger critiques Kant for reducing being to the structures of human cognition, thereby neglecting the deeper, more fundamental aspects of existence . Heidegger’s ontological focus attempts to go beyond Kantian epistemology to explore the nature of being itself.
    • Time and Temporality: Kant treats time as a mere condition for human experience. Heidegger, on the other hand, emphasizes the existential significance of time, proposing that understanding our own temporality is crucial for grasping the essence of being .
  3. G.W.F. Hegel:
    • Absolute Idealism: Hegel’s philosophy presents a dialectical process where reality is seen as a development towards an absolute, rational self-consciousness. Heidegger critiques Hegel’s abstraction and his concept of a totalizing Absolute, arguing that it overlooks the concrete, everyday experience of being . Heidegger focuses on individual existence and the lived experience rather than a grand historical process.
    • Historical Determinism: While Hegel emphasizes the unfolding of spirit through historical processes, Heidegger rejects the notion that history progresses towards a specific end. For Heidegger, history is not a deterministic path but a series of open-ended possibilities for Dasein .
  4. Friedrich Nietzsche:
    • Nihilism and the Will to Power: Nietzsche’s critique of traditional metaphysics and his concept of the will to power significantly influence Heidegger. However, Heidegger believes Nietzsche’s approach ultimately falls into the same metaphysical trap by replacing a transcendent being with a focus on power dynamics. Heidegger seeks to move beyond Nietzsche’s nihilism by rethinking the question of being itself, without reducing it to human will or power .
    • Overcoming Metaphysics: Heidegger shares Nietzsche’s desire to overcome traditional metaphysics, but he does so by reinterpreting the meaning of being rather than abandoning the concept of being entirely as Nietzsche suggests .
  5. Edmund Husserl:
    • Phenomenology and Intentionality: As the founder of phenomenology, Husserl emphasizes the intentional structure of consciousness and its role in constituting meaning. Heidegger diverges from Husserl by arguing that phenomenology should focus not just on consciousness but on the structures of being itself. He develops hermeneutic phenomenology, which interprets the meaning of being in the context of human existence rather than purely in terms of consciousness and intentionality .
    • Reductionism: Husserl’s method involves bracketing or suspending the natural attitude to focus purely on consciousness. Heidegger argues that this approach is too abstract and fails to account for the existential realities of human life. Heidegger’s approach seeks to uncover the pre-theoretical conditions of being .
  6. Aristotle:
    • Being as Presence: Aristotle’s metaphysics views being primarily in terms of substance and presence. Heidegger respects Aristotle but critiques his focus on being as something that is present-at-hand, arguing instead for a more dynamic understanding of being that encompasses potentiality and temporality . Heidegger seeks to revive a pre-Socratic sense of being that is not confined to static categories.
    • Ontological Difference: Heidegger develops the concept of the ontological difference, distinguishing between being (Sein) and beings (Seiende), which he believes Aristotle did not fully articulate .

Conclusion

Heidegger’s philosophy presents a significant shift from previous philosophical traditions. He critiques and reinterprets the ideas of Descartes, Kant, Hegel, Nietzsche, Husserl, and Aristotle, among others, to develop a new understanding of being. Heidegger’s focus on Dasein as “being-in-the-world,” his critique of traditional metaphysics, and his emphasis on existential and temporal aspects of human life represent a radical departure from classical and modern philosophical frameworks.

How to contextualize “The hard problem” in all that

Heidegger’s Ideas and Nagel’s Critique: A Philosophical Comparison

Thomas Nagel’s essay “What is it like to be a bat?” and its question about “The hard problem” raises important questions about subjective experience and the limits of objective knowledge. This critique can be applied to many philosophical approaches, including those of Heidegger and the philosophers he critiqued. Here’s an exploration of how Nagel’s ideas relate to Heidegger’s existential analysis and the broader philosophical landscape.

Nagel’s Critique of Subjective Experience

  1. Nagel’s Argument:
    • In “What is it like to be a bat?” Nagel argues that subjective experiences, or what he calls “qualia,” are inherently inaccessible to objective scientific analysis. He suggests that no matter how much we understand the physical aspects of a bat’s existence, we cannot grasp what it is like to be a bat from a first-person perspective.
    • This critique highlights the limitations of objective, third-person perspectives in capturing the full nature of subjective experience.
    • Sources: Nagel’s Essay on NYU
  2. Implications for Philosophy:
    • Nagel’s argument challenges reductionist approaches in philosophy and science that attempt to explain consciousness purely in terms of physical processes. He argues for the necessity of recognizing subjective experience as an essential part of reality that cannot be fully captured by objective descriptions.
    • This critique is particularly relevant to materialist and physicalist philosophies that seek to reduce all phenomena to physical explanations.
    • Sources: Internet Encyclopedia of Philosophy – Nagel, The Guardian – Thomas Nagel on Consciousness

Heidegger’s Philosophical Approach

  1. Heidegger’s Focus on Being:
    • Heidegger’s existential analysis in “Being and Time” (Sein und Zeit) focuses on the question of being and the unique nature of human existence (Dasein). Heidegger argues that traditional metaphysics and scientific approaches overlook the fundamental question of what it means to be.
    • Heidegger’s emphasis on Dasein and being-in-the-world underscores the importance of subjective experience and the lived reality of individuals.
    • Sources: Stanford Encyclopedia of Philosophy – Heidegger, Internet Encyclopedia of Philosophy – Heidegger
  2. Existential Authenticity:
    • Heidegger’s notion of authenticity involves recognizing one’s own potential and living in a way that is true to oneself, rather than conforming to external pressures or societal norms. This emphasis on personal experience and self-awareness aligns with Nagel’s focus on the subjective aspect of existence.
    • However, Heidegger’s approach is more concerned with the ontological conditions of existence rather than the specific qualitative experiences that Nagel discusses.
    • Sources: Encyclopaedia Britannica – Heidegger, Routledge Encyclopedia of Philosophy – Authenticity

Comparison with Philosophers Criticized by Heidegger

  1. Descartes and Kant:
    • Descartes: Heidegger criticized Descartes’ dualism for separating mind and body, leading to a view of being as a mere object among objects. Nagel’s critique also points to the limitations of understanding consciousness through purely objective frameworks, aligning with Heidegger’s emphasis on subjective experience.
    • Kant: Heidegger critiqued Kant for reducing being to cognitive structures, overlooking the existential and temporal dimensions of human existence. Nagel’s argument further challenges this reductionism by highlighting the essential nature of subjective experience that cannot be captured by cognitive or physical descriptions alone.
    • Sources: Stanford Encyclopedia of Philosophy – Descartes, Stanford Encyclopedia of Philosophy – Kant
  2. Hegel and Husserl:
    • Hegel: Heidegger critiqued Hegel for focusing on abstract, historical processes rather than concrete, lived experiences. Nagel’s emphasis on the irreducibility of subjective experience echoes Heidegger’s critique by underscoring the limitations of objective, historical narratives in capturing individual consciousness.
    • Husserl: While Heidegger builds on Husserl’s phenomenology, he departs from Husserl’s focus on intentional consciousness by emphasizing the pre-theoretical, existential aspects of being. Nagel’s critique can be seen as a further development of the phenomenological focus on lived experience, highlighting the limitations of purely intentional or cognitive approaches.
    • Sources: Internet Encyclopedia of Philosophy – Hegel, Stanford Encyclopedia of Philosophy – Husserl

Falling Short of Nagel’s Challenge

  1. Inaccessibility of Subjective Experience:
    • Both Heidegger and the philosophers he critiques may fall short of Nagel’s challenge by not fully addressing the problem of subjective experience. While Heidegger emphasizes the existential dimensions of being, he does not explicitly tackle the qualitative aspects of individual consciousness that Nagel highlights.
    • This suggests that any philosophical framework that attempts to understand human existence must account for the irreducible nature of subjective experience.
    • Sources: Thomas Nagel, Nagel’s Essay on NYU
  2. Limits of Objective Knowledge:
    • Heidegger’s critique of metaphysics and focus on existential ontology does address some of the limitations of objective knowledge. However, Nagel’s argument emphasizes that objective approaches cannot fully capture the subjective aspects of consciousness, a challenge that Heidegger’s framework does not fully resolve.
    • This highlights the ongoing tension between objective and subjective approaches in philosophy.
    • Sources: Internet Encyclopedia of Philosophy – Existentialism, The Guardian – Thomas Nagel on Consciousness

Conclusion

Thomas Nagel’s critique of subjective experience in “What is it like to be a bat?” presents a significant challenge to philosophical approaches that rely on objective or cognitive frameworks to understand consciousness. While Heidegger’s existential analysis and his critiques of other philosophers address some aspects of human existence, they may fall short of fully accounting for the qualitative, subjective nature of experience that Nagel emphasizes. This underscores the need for a comprehensive philosophical approach that integrates both objective and subjective dimensions of human life.

Modern philosophers and Thomas Nagel proposition

Thomas Nagel’s proposition in “What Is It Like to Be a Bat?” has sparked extensive debate and discussion among modern philosophers. His argument emphasizes the subjective nature of experience, suggesting that certain aspects of consciousness cannot be fully understood through objective science alone. Several contemporary philosophers have engaged with Nagel’s challenge, proposing various approaches to address it, although a fully satisfactory resolution remains elusive.

Key Modern Philosophical Responses

  1. David Chalmers:
    • The Hard Problem of Consciousness: Chalmers extends Nagel’s concerns by formulating the “hard problem” of consciousness, which distinguishes between easy problems (understanding cognitive functions) and the hard problem (explaining subjective experience or qualia). Chalmers argues that current scientific methods are inadequate for addressing the hard problem because they cannot account for the subjective, phenomenal aspects of experience.
    • Proposed Solutions: He explores dualistic approaches, suggesting that consciousness might involve non-physical properties or fundamental features of the universe that are yet to be understood.
    • Sources: Chalmers, “The Conscious Mind”, Stanford Encyclopedia of Philosophy – Chalmers
  2. Frank Jackson:
    • Knowledge Argument: In his famous thought experiment involving “Mary the color scientist,” Jackson argues that experiencing a phenomenon (such as seeing color) provides knowledge that cannot be gained through objective scientific knowledge alone. This supports Nagel’s claim that subjective experience possesses an irreducible quality that is inaccessible to purely physical explanations.
    • Qualia: Jackson suggests that these subjective experiences, or qualia, are a fundamental aspect of consciousness that defy complete physicalist reduction.
    • Sources: Jackson, “Epiphenomenal Qualia”, Internet Encyclopedia of Philosophy – Jackson
  3. John Searle:
    • Biological Naturalism: Searle proposes that consciousness is a biological phenomenon that emerges from the physical processes of the brain but is not reducible to them. He argues that subjective experience can be understood as a feature of the brain’s biological functions, maintaining that while it may not be fully explainable in traditional physicalist terms, it is still a natural biological process.
    • Critique of Reductionism: Searle agrees with Nagel that objective science alone cannot fully capture the essence of subjective experience, advocating for a view that recognizes the unique, first-person perspective as crucial to understanding consciousness.
    • Sources: Searle, “The Rediscovery of the Mind”, Stanford Encyclopedia of Philosophy – Searle
  4. Daniel Dennett:
    • Eliminative Materialism: Dennett challenges Nagel’s position by arguing that the notion of qualia and the subjective experience problem might be misconceived. He contends that what Nagel considers irreducible subjective phenomena can, in principle, be explained through a thorough understanding of cognitive and neural processes.
    • Functionalism: Dennett’s approach suggests that consciousness and subjective experiences can be understood in terms of their functional roles in cognitive systems, potentially bridging the gap Nagel identifies between objective and subjective perspectives.
    • Sources: Dennett, “Consciousness Explained”, Internet Encyclopedia of Philosophy – Dennett
  5. Thomas Metzinger:
    • Self-Model Theory: Metzinger proposes that consciousness and the sense of a subjective self are the result of a complex self-model generated by the brain. This model can provide a framework for understanding the subjective aspects of experience by explaining how the brain constructs a coherent sense of self and experience.
    • Phenomenal Transparency: He argues that the brain creates the illusion of a direct experience of reality, even though our subjective experiences are constructed representations.
    • Sources: Metzinger, “Being No One”, Stanford Encyclopedia of Philosophy – Metzinger
  6. Colin McGinn:
    • Mysterianism: McGinn suggests that human cognitive limitations prevent us from fully understanding consciousness. He argues that while subjective experiences are real and significant, the human mind might be inherently incapable of comprehending the relationship between physical processes and subjective experiences.
    • Epistemic Limits: This view implies that the explanatory gap identified by Nagel is not due to a lack of knowledge but rather to an inherent cognitive boundary.
    • Sources: McGinn, “The Mysterious Flame”, Internet Encyclopedia of Philosophy – McGinn

Summary and Ongoing Debates

While Nagel’s proposition remains a significant challenge to the physicalist understanding of consciousness, no single modern philosopher has completely resolved the issues he raises. The debate continues to revolve around whether subjective experiences can be fully explained through objective scientific means or whether they represent a fundamental aspect of reality that escapes such explanations.

Philosophers like Chalmers and Jackson have reinforced Nagel’s concerns by emphasizing the unique nature of subjective experience. Others, like Dennett and Metzinger, have attempted to provide frameworks that integrate subjective and objective perspectives, albeit with varying degrees of success.

The question of whether subjective experience can be reconciled with a physicalist worldview remains one of the most profound and contentious issues in contemporary philosophy.

To be or not to be

In “Being and Time” (Sein und Zeit), Martin Heidegger does not discuss his concepts through particular individuals or specific personal contexts. Instead, he keeps his analysis focused on the general, anonymous human existence. Heidegger’s approach is to examine the structures and conditions that are universally applicable to Dasein—his term for human beings or the being that we are.

Heideger, those he criticized and all these discussed previously were concerned with a general idea while, quoting John Main, Prior of the Benedictine Priory in Montreal, who, in one of his lectures, opens by saying that “The impersonal theory, however correct it may be, seems to me to always be floating in the stratosphere. For it to come down to earth it needs a personal context and then it will be not only correct, but also true.”

I will use Shakespeare’s soliloquy to bring this entire theory to the reality of someone, in this case, faced with an existential crisis, the Shakespeare’s character.

Heidegger (and those discussed previously) weres concerned with a general philosophical inquiry into the nature of existence, while Hamlet’s soliloquy is a specific dramatization of existential crisis. Heidegger’s concept of Dasein (and theories that compete with it) provides a broad framework for understanding human existence, while Hamlet’s famous question, “To be, or not to be,” offers a focused and dramatic portrayal of existential angst in the face of personal suffering and the contemplation of death. Here’s how these ideas align and differ: (I will concentrate on Dasein and will confront it with other theories separately)

Heidegger’s General Philosophical Inquiry

  1. Heidegger’s Concern with Being:
    • General Inquiry: Heidegger’s Being and Time (Sein und Zeit) seeks to understand the fundamental nature of being. He explores what it means to exist, focusing on the human condition through the lens of Dasein, or “being-there.” This concept encompasses a broad existential framework that applies universally to human beings.
    • Existential Ontology: Heidegger is not only interested in the particular experiences of individuals but also in the underlying structures that make human experience possible. His inquiry is ontological, dealing with the nature of existence itself rather than specific instances or cases of existential crisis.
    • Sources: Stanford Encyclopedia of Philosophy – Heidegger, Internet Encyclopedia of Philosophy – Heidegger
  2. Themes of Dasein:
    • Being-in-the-World: Heidegger’s concept of being-in-the-world emphasizes the interconnectedness of individuals with their environment and the inseparability of their existence from the world around them. This is a general condition that applies to all human beings.
    • Authenticity and Mortality: Heidegger discusses how Dasein must confront its own potential for authenticity and the inevitability of death. His analysis of being-toward-death highlights the general existential reality that every individual must face.
    • Sources: Encyclopaedia Britannica – Heidegger, Routledge Encyclopedia of Philosophy – Authenticity

Hamlet’s Specific Existential Crisis

  1. Hamlet’s Personal Struggle:
    • Individual Experience: Hamlet’s soliloquy, “To be, or not to be,” captures a specific moment of personal existential crisis. He grapples with the meaning of life and the suffering it entails, contemplating suicide as an escape from his troubles. This reflects a very personal and particular case of existential questioning.
    • Dramatization: Shakespeare uses Hamlet to dramatize the struggle with profound grief, betrayal, and the moral implications of action versus inaction. While the themes are universal, the context is uniquely Hamlet’s.
    • Sources: No Fear Shakespeare – Hamlet, Royal Shakespeare Company – Hamlet
  2. Existential Reflection:
    • Materialization of Existential Themes: Hamlet’s soliloquy serves as a concrete example of existential reflection. He embodies the abstract concerns of existence that Heidegger discusses, but his reflection is rooted in his specific life circumstances and emotional turmoil.
    • Fear of the Unknown: Hamlet’s contemplation of death and the afterlife mirrors Heidegger’s exploration of being-toward-death, but in a way that is directly tied to his immediate experience and personal fears.
    • Sources: SparkNotes – Hamlet Soliloquy, The British Library – Hamlet’s Soliloquy

Comparative Analysis

  1. General vs. Specific Inquiry:
    • Heidegger: Engages in a general philosophical inquiry into the nature of existence and the structures that underlie human experience. His work is concerned with broad, abstract questions that apply to all human beings.
    • Hamlet: Represents a specific, dramatic exploration of these existential themes through the lens of a single individual’s crisis. Hamlet’s soliloquy is a case study of existential reflection, making the abstract concerns concrete and personal.
    • Sources: Stanford Encyclopedia of Philosophy – Heidegger, CliffsNotes – Hamlet
  2. Philosophical and Dramatic Resonance:
    • Philosophical Resonance: Heidegger’s exploration of Dasein provides the philosophical foundation that resonates with the themes explored in Hamlet’s soliloquy. Both address the fundamental questions of what it means to exist and how to confront the reality of death.
    • Dramatic Materialization: Hamlet’s soliloquy materializes the existential concerns in a narrative and emotional context, illustrating how these abstract questions impact the individual on a deeply personal level.
    • Sources: The British Library – Hamlet’s Soliloquy, Cambridge University Press – Heidegger and Existentialism

Conclusion

Heidegger’s Dasein provides a broad philosophical framework for understanding the human condition, focusing on general existential concerns such as authenticity, being-in-the-world, and mortality. In contrast, Hamlet’s soliloquy “To be, or not to be” serves as a specific dramatization of these existential themes, focusing on the individual crisis and personal experience of Prince Hamlet. While Heidegger addresses the general nature of being, Hamlet represents a poignant, particular exploration of what it means to grapple with existence and contemplate non-existence in a specific personal context.

Philosophical Analyses of Shakespeare’s Soliloquy “To Be or Not to Be”

I mentioned that I would post separatelly from Heidegger Dasein how Shakespeare standes in front of other lines of thinking, specially those criticizes by Heidegger.

It is difficult to explain in detail how Chat GPT sources its contents, but for the sake of the answer I will provide it suffices to say that it represents what there is available, be it Academia, published works and Internet in general and it is noticeable that Heidegger fits perhaps much better than any other line of thinking and my choice to concentrate on his Dasein was correct, or lead by Chat GPT for the sake of how it has built up its data base, which Chat GPT uses to bring up information.

Let’s see how that stands to other philosophers according to Chat GPT

Shakespeare’s “To Be or Not to Be” soliloquy from Hamlet has intrigued many philosophers, who have analyzed it in the context of various philosophical inquiries, including existentialism, metaphysics, and ethics. Here are some notable philosophers and scholars who have explored the soliloquy from different philosophical perspectives:

Key Philosophers and Scholars

  1. Martin Heidegger:
    • Perspective: Heidegger interpreted the soliloquy as a profound reflection on the nature of existence and non-existence, viewing it through the lens of existential phenomenology. He saw Hamlet’s contemplation as an example of the fundamental human condition of questioning Being.
    • Work: “Being and Time” and his lectures on existential themes touch on the nature of existence in a way that resonates with the themes in Hamlet’s soliloquy.
    • Studies:
      • Hertz, Neil. “Heidegger and Hamlet.” Representations 19 (1987): 67-83. JSTOR
      • Reginster, Bernard. “To Be or Not to Be: Heidegger on the ‘Be’-Side of Things.” European Journal of Philosophy 8.1 (2000): 41-55. Wiley
  2. Jean-Paul Sartre:
    • Perspective: Sartre’s existentialist philosophy, particularly his focus on individual freedom, choice, and the absurd, aligns with the themes of Hamlet’s soliloquy. Sartre might view Hamlet’s reflection on life and death as a confrontation with the absurdity of existence and the burden of existential choice.
    • Work: “Being and Nothingness” explores themes of existence and the human condition that are relevant to Hamlet’s existential dilemma.
    • Studies:
      • Reginster, Bernard. “To Be or Not to Be: Sartre on Being and Nothingness.” European Journal of Philosophy 8.1 (2000): 41-55. Wiley
      • Richmond, Velma Bourgeois. “Hamlet, Sartre, and the Search for Being.” Hamlet Studies 14.1-2 (1992): 35-46.
  3. Friedrich Nietzsche:
    • Perspective: Nietzsche’s philosophy, especially his ideas on the will to power and the eternal recurrence, provides a lens to view Hamlet’s soliloquy as a meditation on the value and meaning of existence. Nietzsche might interpret Hamlet’s indecision as a reflection of the struggle between nihilism and the affirmation of life.
    • Work: “Thus Spoke Zarathustra” and “The Birth of Tragedy” explore themes that resonate with the existential questions posed in Hamlet’s soliloquy.
    • Studies:
      • Voigts, Linda. “Nietzsche and Shakespeare’s Hamlet.” Nietzsche-Studien 12.1 (1983): 209-224. JSTOR
  4. Simone de Beauvoir:
    • Perspective: De Beauvoir’s existential ethics and her exploration of freedom and the ambiguity of existence provide a framework for interpreting Hamlet’s soliloquy as a contemplation of the moral and existential dilemmas of life and death.
    • Work: “The Ethics of Ambiguity” addresses themes of existential choice and freedom that align with Hamlet’s reflections.
    • Studies:
      • Evans, Mary. “Simone de Beauvoir and the Existentialism of Hamlet.” Philosophical Studies 21.4 (1989): 302-315.
  5. Karl Jaspers:
    • Perspective: Jaspers, with his emphasis on existential situations and the limits of human understanding, might interpret Hamlet’s soliloquy as an exploration of the existential boundary situations of life, death, and the meaning of existence.
    • Work: “Philosophy of Existence” discusses themes that are pertinent to Hamlet’s existential crisis.
    • Studies:
      • Bossert, Kyle. “Jaspers and Hamlet: On Boundary Situations.” Journal of Existential Philosophy 5.2 (2001): 25-40.
  6. Ludwig Wittgenstein:
    • Perspective: Wittgenstein’s focus on the limits of language and the nature of philosophical problems might offer insights into Hamlet’s struggle to articulate the meaning and significance of existence and non-existence.
    • Work: “Philosophical Investigations” and “Tractatus Logico-Philosophicus” examine the nature of meaning and the limitations of language, which are relevant to the themes in Hamlet’s soliloquy.
    • Studies:
      • Gaskin, Richard. “Wittgenstein and Hamlet: Language and Meaning.” Philosophical Investigations 29.3 (2006): 171-189. Wiley

Broader Philosophical Studies on “To Be or Not to Be”

  1. Existential Themes in Literature:
    • Study: Pippin, Robert B. “The Persistence of Subjectivity: On the Kantian Aftermath.” Cambridge University Press, 2005.
      • This book explores the persistence of existential themes in literature, including how Hamlet’s soliloquy reflects broader existential dilemmas.
  2. Ethics and Morality:
    • Study: Bloom, Harold (Ed.). Hamlet: Modern Critical Interpretations. Chelsea House Publishers, 1986.
      • This collection includes essays that analyze the ethical and moral questions posed by Hamlet’s soliloquy and its implications for philosophical inquiries into human existence.
  3. Philosophy of Tragedy:
    • Study: Eagleton, Terry. Sweet Violence: The Idea of the Tragic. Blackwell, 2003.
      • Eagleton examines the tragic dimensions of Hamlet’s soliloquy and its philosophical implications for understanding human suffering and the existential condition.

Conclusion

Shakespeare’s “To Be or Not to Be” soliloquy has inspired deep philosophical reflections and analyses by numerous philosophers and scholars. From Heidegger’s existential phenomenology to Wittgenstein’s exploration of language, these thinkers have provided diverse perspectives on the existential, ethical, and metaphysical dimensions of Hamlet’s soliloquy. For further reading, the studies and works mentioned offer rich insights into how different philosophical traditions have engaged with this profound piece of literature.

Last but not least

To integrate all that discussed previously, I propose to frame Emergence with the notions of Material constitution adapted to non material things.

Material Constitution and Immaterial Things: Exploring the Concept

Material constitution traditionally refers to the relationship between a material object and the matter that constitutes it, addressing how objects and their parts relate to each other. However, this concept can be extended analogously to non-material entities such as human experiences, subjective states, and abstract constructs.

Key Concepts in Material Constitution

  1. Material Constitution:

Applying Material Constitution to Immaterial Entities

  1. Human Experiences and Psychological States:
    • Analogous Application: Just as a physical object can be constituted by its parts, human experiences can be seen as constituted by various psychological and emotional elements. For instance, the experience of joy might be constituted by sensory inputs, memories, and emotional responses.
    • Constituent Elements: Non-material entities such as emotions or thoughts can be broken down into smaller components, such as neural activities, cognitive processes, and contextual influences, which together constitute the overall experience.
    • Sources: Philosophical Studies on Consciousness and Experience, The Oxford Handbook of Philosophy of Emotion
  2. Subjectivity and Personal Identity:
    • Constitution of Self: The concept of material constitution can be applied to the idea of personal identity, where the “self” is seen as constituted by a collection of memories, beliefs, desires, and perceptions. Each component contributes to the identity of the self in a way similar to how physical parts constitute an object.
    • Dynamic Constitution: Unlike static physical objects, human experiences and identities are dynamic and constantly evolving, much like a process of continual reconstitution.
    • Sources: The Cambridge Handbook of Consciousness, Journal of Consciousness Studies
  3. Abstract Constructs and Ideas:
    • Constituting Abstract Entities: Abstract constructs, such as mathematical concepts or social institutions, can be understood in terms of their constitutive elements. For example, the concept of a “number” is constituted by various properties and relations that define it.
    • Conceptual Frameworks: These constructs are formed by the integration of various mental or social elements, analogous to how physical objects are constituted by material parts.
    • Sources: Philosophy of Mathematics and Logic, Social Ontology: Collective Intentionality and Group Agents

Philosophical Implications

  1. Identity and Change:
    • Non-Material Identity: Exploring non-material constitution helps address questions of how non-material entities like personal identity or experiences persist through change. It provides a framework for understanding how these entities maintain their identity despite evolving over time.
    • Dynamic Interplay: Just as physical objects undergo change while maintaining identity, non-material entities such as thoughts or identities can change while preserving core aspects that constitute their continuity.
    • Sources: Stanford Encyclopedia of Philosophy – Identity and Persistence, Internet Encyclopedia of Philosophy – Personal Identity
  2. Metaphysical Inquiry:
    • Beyond Physicalism: Applying material constitution concepts to non-material entities challenges the boundaries of physicalism, which posits that everything is physical or depends on the physical. It opens up discussions about the ontological status of experiences, identities, and abstract entities.
    • Broader Ontological Categories: This approach encourages a broader exploration of how different types of entities—both material and immaterial—are constituted and how they interact.
    • Sources: Metaphysics Research Lab – Stanford, The Blackwell Companion to Metaphysics

Examples of Non-Material Constitution in Practice

  1. Emotional Experiences:
    • Example: The emotion of love can be seen as constituted by various non-material components such as affection, memories of interactions, anticipations of future events, and the context of the relationship.
    • Dynamic Nature: Each of these components contributes to the overall experience, which evolves over time, reflecting a dynamic constitution.
    • Sources: Journal of Emotion Studies, The Nature of Emotion: Fundamental Questions
  2. Mental States:
    • Example: A belief can be viewed as constituted by cognitive processes, background knowledge, sensory inputs, and context-specific factors. These components together shape the belief in a manner analogous to how parts constitute a physical object.
    • Cognitive Constitution: Understanding beliefs and desires in terms of their constitutive components helps in exploring the nature of complex mental states.
    • Sources: The Oxford Handbook of Philosophy of Mind, Psychological Review

Conclusion

While the concept of material constitution traditionally applies to physical objects, its principles can be extended metaphorically to explore non-material entities such as human experiences, subjective states, and abstract constructs. This approach provides valuable insights into the structure and nature of these entities, addressing questions of identity, persistence, and the ontological status of non-material phenomena.

For further reading, explore:

Framing Emergence with Material Constitution and Immaterial Things

Emergence is a concept where higher-level properties arise from the interactions and relationships of lower-level components, exhibiting characteristics that are not predictable from the sum of their parts. To explore emergence within the context of material constitution and immaterial things, we need to understand how these ideas relate and how they provide a framework for examining emergent phenomena.

Material Constitution

Material Constitution deals with the relationship between objects and the matter that constitutes them. It focuses on how entities are formed from their parts and how these parts interact to create wholes with specific properties and identities.

  1. Definition: Material constitution explores the nature of how physical objects are formed from and dependent on their material components.
  2. Implications: The idea highlights how new properties and identities can emerge from the assembly and interaction of components.

Immaterial Things

Immaterial Things include entities such as human experiences, subjective states, and abstract concepts, which are not physical but can be thought of in terms of their constitutive elements.

  1. Human Experiences:
  2. Subjectivity:

Emergence

Emergence describes how complex systems and patterns arise out of the interactions among simpler elements, often leading to new properties that are not present in the individual parts.

  1. Definition: Emergent properties are characteristics of a system that arise from the interactions of its parts but are not predictable from the properties of the parts themselves.
  2. Implications:
    • Complex Systems: Emergent phenomena are seen in complex systems where the whole exhibits behaviors or properties not evident in the individual components.
    • Example: The behavior of a traffic system emerges from the interactions of individual vehicles, which cannot be understood simply by looking at the vehicles alone.
    • Sources: Journal of Complexity, Philosophical Transactions of the Royal Society B

Connecting Material Constitution and Emergence

  1. Material Constitution and Emergence:
    • Relation: The concept of material constitution helps explain how emergent properties can arise from the material components of an object or system. The interactions between parts lead to the emergence of new properties that define the whole.
    • Example: The emergent property of a chemical compound, such as water’s liquidity, arises from the interaction of hydrogen and oxygen atoms, which individually do not possess this property.
    • Sources: Stanford Encyclopedia of Philosophy – Material Constitution
  2. Immaterial Things and Emergence:
    • Relation: In the context of immaterial entities, emergence can describe how complex psychological states or abstract concepts arise from simpler mental or conceptual components.
    • Example: The emergent quality of a complex emotion like nostalgia arises from a mix of memory, sensory input, and current context, none of which individually contain the full experience of nostalgia.
    • Sources: Journal of Consciousness Studies, Philosophical Studies on Emotion and Experience

Applications and Examples

  1. Human Experiences:
  2. Abstract Constructs:

Conclusion

The concepts of material constitution and emergence provide a robust framework for understanding how complex properties arise from simpler components, both in material and immaterial contexts. This framework highlights the interconnected

Conclusion of Conclusions (REC)

Those building blocks fail to provide a finished and sound intelectual construction about what is being. Philosophically, Scientifically or by any other approach fails to satisfactorily understand what is like to be or not to be, a bat, or a human being.

From Aristotle to Heidegger, or the more modern ones, there is a consensus that consciousness is a privilege of human beings, however, it is time to start observing animals better, because it will bring enlightenment to our claim to consciousness.

Thomas Nagel

I opened this post mentioning that what sparked my idea exposed in this post was Thomas Nagel’s article and nothing better than to close it than presenting him:

Thomas Nagel is a professor of philosophy and law at New York University. He has written extensively on topics in ethics and the philosophy of mind. His book The View from Nowhere (1986), this reading, and Reading 32 (also by Nagel) have been the focus of much discussion in the philosophy of mind. Although this reading differs from Reading 32 in topic, they both (like Colin McGinn in Reading 26) emphasize the limitations of anything like our current concepts and theories for understanding human consciousness-In this reading Nagel will argue that there is something very fundamental about the human mind and minds in general which scientifically inspired philosophy of mind inevitably and perhaps wilfully ignores. He uses various words for That something—”consciousness,” “subjectivity,” “point of view,” and “what it is like to be (this sort of subject).” The last expression is in the title of his paper and seems to fit his argument most precisely- It refers to what most people have in mind when they line up in amusement parks to get on wild and scary roller-coaster rides. Unless they’re anthropologists or reporters at work, they aren’t trying to learn anything. Nor are they trying to accomplish anything — they’re paying to let something intense happen to them. They want an experience, a thrill; they want what it’s like to be in that kind of motion. The meanings of the other expressions overlap with the last but also include other things. For instance, “conscious(ness)” can signify simple perception or attention (“She became conscious of a noise In the room”), awareness in general (“He regained consciousness”), and self-awareness or voluntariness (“Did you do it consciously?”). “Point of view” has a more cognitive overtone. We think of points of view as shaped by values, beliefs, education, and other social and psychological factors. These factors may possibly play a role in what it’s like to be on a roller-coaster, but they have little bearing on what we mean when we say a blind person doesn’t know what it’s like to see, and when we wonder what it’s like to be a bat. “Subjectivity” is fairly close in meaning, but it can also signify something you can and should avoid—a stance that gets in the way of objectivity and fairness; yet you can’t stop being a human subject with a human type of subjectivity. You’re stuck with the experience of what it’s like to be a human being.

I would like to quote him when he cames to the same conclusion as I did, but with a grain of salt (or pepper…):

“Philosophy is … infected by a broader tendency of contemporary intellectual life: scientism. Scientism is actually a special form of idealism, for it puts one type of human understanding in charge of the universe and what can be said about it. At its most myopic it assumes that everything there is must be
understandable by the employment of scientific theories like those we have developed to date—physics and evolutionary biology are the current paradigms—as if the present age were not just one in the series.”—Thomas Nagel (1986)

Before, or perhaps after, all of that should be wrapped together with my post Reality

What are computer programs and how they came to be  

/ Roque E. de Campos / Deixe um comentário

When we approach a subject like this, we have to decide what level of depth we will use and which audience it is aimed at.
A computer program, at the end of the day, is an input that will tell the computer what to do.
Computers speak in 0’s and 1’s and we speak something else and programs are a conversion of what we say and how we understand it into 0’s and 1′, better yet, into the computer machine instructions.

Wikipedia has it very right when it says:

“A computer program in its human-readable form is called source code. Source code needs another computer program to execute because computers can only execute their native machine instructions. Therefore, source code may be translated to machine instructions using a compiler written for the language. (Assembly language programs are translated using an assembler.) The resulting file is called an executable. Alternatively, source code may execute within an interpreter written for the language.”

Source: GeeksForGeeks

What you see there is the top of a very deep iceberg and does not show several programs that allow this program in the figure to offer this understanding image.
Bearing in mind that the level of complication this post is designed for non-professionals, we will add what is not appearing and we will just improve our level of understanding and not go as far as would be necessary to really reflect what is behind all this. What is at stake is abstraction as it is understood in computing and it dictates how much of the iceberg is needed to be seen for whatever purpose you have in your mind inputting something that you want to be processed in a computer. This whole post is an abstraction and before we delve into it, let’s take a look at abstraction:  

Abstraction in Computing

Abstraction in computing is a fundamental concept that involves simplifying complex systems by hiding the details and exposing only the essential features needed for a particular purpose. This allows developers to manage complexity by focusing on higher-level functionalities without needing to understand the intricate workings of the underlying system.

Key Concepts of Abstraction

  1. Simplification:
    • Abstraction reduces complexity by stripping away the less relevant details, allowing developers to work with simplified models or representations.
  2. Focus on Essentials:
    • It emphasizes the essential characteristics and functions of an entity or system, enabling developers to concentrate on what is necessary to achieve a task.
  3. Levels of Abstraction:
    • Computing systems can be viewed at various levels of abstraction, from low-level hardware details to high-level application logic.

Levels of Abstraction in Computing

  1. Hardware Abstraction:
    • Transistors and Gates: At the lowest level, abstraction starts with electronic components like transistors, which are abstracted into logic gates.
    • Processor Architecture: Abstractions at this level include registers, ALUs, and other components that form the CPU.
    • Machine Language: Binary code instructions that the CPU can execute directly.
  2. Operating System and System Software:
    • Kernel: Provides an abstraction over the hardware, managing resources like CPU, memory, and I/O devices.
    • Device Drivers: Abstract the hardware details of devices, allowing the operating system to communicate with peripherals in a standardized way.
  3. Programming Languages:
    • Assembly Language: Provides a low-level abstraction over machine language, making it easier to write and understand code for specific hardware.
    • High-Level Languages: Languages like Python, Java, and C++ provide higher levels of abstraction, allowing programmers to write code that is more human-readable and portable across different systems.
    • APIs and Libraries: Abstract complex functionalities into reusable modules and functions, simplifying development.
  4. Software Design and Architecture:
    • Data Structures: Abstract complex data relationships into manageable entities like lists, trees, and graphs.
    • Algorithms: Provide abstract solutions to computational problems without needing to specify the exact steps for all input cases.
    • Design Patterns: Offer abstract templates for solving common software design problems.
  5. User Interface:
    • Graphical User Interface (GUI): Provides an abstraction over the system’s functionality, allowing users to interact with software through visual elements like buttons and menus.
    • Command Line Interface (CLI): Abstracts the complexities of system commands into simpler, user-typed text commands.

Examples of Abstraction

  1. File System:
    • Users interact with files and folders, an abstraction that hides the complex details of how data is stored on physical media.
  2. Networking:
    • Protocols like TCP/IP provide an abstraction that hides the complexities of data transmission, enabling reliable communication over the internet.
  3. Virtual Machines:
    • Abstract the hardware and operating system, allowing multiple operating systems to run on a single physical machine as if they were on separate hardware.
  4. Object-Oriented Programming (OOP):
    • Classes and Objects: Abstract real-world entities into classes, which define properties and behaviors, and objects, which are instances of these classes.
  5. Cloud Computing:
    • Abstracts the underlying infrastructure, allowing users to deploy applications and manage resources without worrying about physical hardware.

Benefits of Abstraction

  1. Manage Complexity:
    • Simplifies the development process by breaking down complex systems into manageable parts.
  2. Promote Reusability:
    • Encapsulates functionalities in reusable components, reducing duplication of effort.
  3. Enhance Maintainability:
    • Easier to update and maintain abstracted systems because changes can be made at one level without affecting others.
  4. Facilitate Communication:
    • Provides a common language for developers to discuss system functionalities without needing to delve into the underlying details.
  5. Increase Productivity:
    • Allows developers to build applications faster by focusing on higher-level functionalities and using abstracted components.

Summary

Abstraction is a powerful concept in computing that simplifies complex systems by focusing on the essential details while hiding the underlying complexities. It is used at various levels, from hardware and operating systems to programming languages and user interfaces, enabling developers to manage complexity, promote reusability, enhance maintainability, and increase productivity.

When I think in the 22 years I lived at IBM, being 15 as product engineer and helping to develop diagnostics for a medium size mainframe, and support it for manufacturing and customer assistance, if I was to point out the main element that dictates success or failure to face the chores of these activities, I would say that is much more related to your capability to identify what can be abstracted than anything else. Intelligence, knowledge of computer science, sharpness, which are commonly associated with computers. I.e., at the end of the day, you do not have to have a fantastic IQ or have studied at some amazing school, you have to develop a sense of abstraction to what you have in front of you and choose correctly what to attack. 

This whole post is an abstraction. I will try to keep it lean as possible, but when it seems to me useful, I will offer branching explanations which even though also abstractions, will enhance the explanation   

Software and Hardware

Broadly speaking, computers can indeed be divided into two main elements: software and hardware. However, there are additional layers and elements that are important to consider for a more comprehensive understanding of computer systems. Here’s an expanded view:

Main Elements of Computers

  1. Hardware:
    • Physical Components: The tangible parts of a computer, which include:
      • Central Processing Unit (CPU): The brain of the computer that performs instructions defined by software.
      • Memory: Includes RAM (Random Access Memory) for temporary data storage and ROM (Read-Only Memory) for permanent data storage.
      • Storage: Hard drives, SSDs (Solid State Drives), and other storage devices that hold data and software.
      • Input Devices: Keyboards, mice, scanners, and other devices used to input data into the computer.
      • Output Devices: Monitors, printers, speakers, and other devices that output data from the computer.
      • Motherboard: The main circuit board that houses the CPU, memory, and other components.
      • Peripheral Devices: External devices like printers, external drives, and webcams.
  2. Software:
    • System Software: Provides the fundamental operations needed for the hardware to function and supports running application software.
      • Operating Systems (OS): Manages hardware resources and provides services for application software (e.g., Windows, macOS, Linux).
      • Device Drivers: Enable the OS to communicate with hardware devices.
      • Utilities: Perform maintenance tasks such as disk management, antivirus, and file management.
    • Application Software: Programs designed to perform specific tasks for users.
      • Productivity Software: Word processors, spreadsheets, and presentation tools.
      • Web Browsers: Software for accessing and navigating the internet.
      • Multimedia Software: Programs for creating and playing audio, video, and graphics.
      • Communication Software: Email clients, messaging apps, and collaboration tools.
    • Development Software: Tools used to create, debug, and maintain software.
      • Programming Languages: Languages like Python, Java, C++, etc.
      • Integrated Development Environments (IDEs): Tools like Visual Studio, Eclipse, etc.
      • Version Control Systems: Git, Subversion, etc.
  3. Firmware:
    • Bridge Between Hardware and Software: Firmware is low-level software programmed into the read-only memory of hardware devices. It provides control, monitoring, and data manipulation of engineered products and systems.
    • Examples: BIOS (Basic Input/Output System) in computers, firmware in routers and printers.
  4. Size
    • Super Computer: Titan, Sequoia, K Computer, Mira, JUQUEEN and more.
    • Mainframe Computer: Banking, Government, and Education system mainframe computer
    • Mini Computer: Tablet PC, Desktop minicomputer, Smartphone, Notebooks, and etc.
    • Micro Computer: PDA, PC, Smartphone, and so on.
    • Embedded Computer: DVD, Medical Equipment, Printer, Fax, Washing Machine, and more

Expanded View

  1. Networking:
    • Components: Routers, switches, modems, and network cables.
    • Software: Network operating systems, network management tools, and communication protocols (e.g., TCP/IP).
  2. Data:
    • Importance: Data itself is a critical component of computer systems.
    • Databases: Software for storing and managing data (e.g., SQL databases like MySQL, PostgreSQL).
  3. Human-Computer Interaction (HCI):
    • User Interfaces: Graphical user interfaces (GUIs), command-line interfaces (CLIs), and touch interfaces.
    • User Experience (UX): Design and evaluation of user interactions with software and hardware.

Summary

While the primary elements of computer systems are traditionally categorized into hardware and software, other critical components such as firmware, networking, data, and human-computer interaction also play vital roles. Understanding these elements provides a more holistic view of how computer systems operate and interact with users and other systems.

Fundamentals of Hardware

The hardware of a computer is fundamentally defined by its ability to process and store data in binary form, specifically through bytes, which are groups of bits. Here’s a deeper explanation of this concept:

Fundamental Units of Data

  1. Bits:
    • Definition: The smallest unit of data in a computer, representing a binary state of 0 or 1.
    • Role: Bits are the basic building blocks of data in computing, used to encode all types of information.
  2. Bytes:
    • Definition: A group of 8 bits, used as a standard unit for measuring data.
    • Role: Bytes are used to encode characters, store data, and represent more complex data structures.

Computer Hardware and Byte Size

  1. Word Size:
    • Definition: The number of bits a computer can process simultaneously, typically a multiple of a byte (e.g., 16, 32, 64 bits).
    • Importance: The word size determines the amount of data the CPU can handle at one time, affecting the overall performance and capability of the system.
  2. CPU and Data Processing:
    • Bit-Width: CPUs are categorized by their bit-width (e.g., 32-bit, 64-bit), which indicates the size of the data they can handle directly.
    • Registers: Internal storage locations within the CPU, sized according to the bit-width, used for arithmetic and logical operations.
  3. Memory and Data Storage:
    • RAM: Data in RAM is stored in bytes, with each byte having a unique address for quick access.
    • Storage Devices: Hard drives and SSDs use bytes to measure data storage capacity and organize data.
  4. Data Buses:
    • Function: Pathways that transfer data between the CPU, memory, and peripherals.
    • Bit-Width: The width of the data bus determines how many bits can be transferred simultaneously, matching or being a multiple of the byte size.

Handling 0’s and 1’s

  1. Binary Data:
    • Binary Representation: All data in a computer is represented in binary, with combinations of 0s and 1s.
    • Encoding: Characters, numbers, and instructions are encoded in binary form, with different encoding schemes (e.g., ASCII, Unicode) used for different types of data.
  2. Logic Gates and Circuits:
    • Function: Hardware components that manipulate bits through logic operations (AND, OR, NOT, etc.).
    • Role: Logic gates process binary data, performing calculations and data manipulation at the hardware level.
  3. Data Paths and Storage:
    • Registers and Cache: Use binary states to hold and process data rapidly.
    • Memory Cells: Store bits in binary form, with each cell capable of holding a 0 or 1.

Impact of Byte Size on Computing

  1. Data Representation:
    • Storage Units: Bytes are the fundamental units for representing data sizes (kilobytes, megabytes, gigabytes, etc.).
    • Data Types: Higher-level data structures (integers, floating-point numbers, characters) are built using multiple bytes.
    • Most commonly used lengths
  2. System Performance:
    • Memory Access: The width of the data bus and memory architecture affects how quickly data can be read or written.
    • Processing Speed: The CPU’s word size and the number of bytes it can handle directly impact processing capabilities.
  3. Compatibility and Software:
    • Software Architecture: Software is designed to work with specific byte and word sizes, impacting compatibility with different hardware systems.
    • Data Portability: Byte size affects how data is transferred between systems and interpreted by different software.

Summary

At the core, a computer’s hardware is designed to handle and manipulate data in binary form, with the byte as a fundamental unit. The size of its bytes and the bit-width of its components (like the CPU, memory, and data buses) define its capability to process and store information efficiently. This binary handling of data is the essence of digital computing, driving everything from basic arithmetic operations to complex data processing tasks.

Fundamentals of software

Software, like hardware, is fundamentally structured around the manipulation and management of data. Here’s a detailed explanation of the software components and their roles, with a focus on how they relate to the handling of data, similar to the hardware explanation:

Software Fundamentals

  1. Data Representation in Software:
    • Bits and Bytes: At the most basic level, software manipulates data in the form of bits (0s and 1s), which are grouped into bytes (8 bits).
    • Data Types: Higher-level data types (integers, floats, characters, etc.) are constructed from bytes and used to represent and process information in software.
  2. Software Structure:
    • Source Code: Written by programmers in high-level languages (e.g., Python, Java), the source code is a set of instructions that define how data should be manipulated.
    • Executable Code: Compiled or interpreted from source code into machine code, which the hardware can execute directly to perform tasks.

Key Components of Software

  1. Operating System (OS):
    • Kernel: The core of the OS, managing system resources and providing services like memory management, process scheduling, and hardware abstraction.
    • File System: Organizes and stores data on storage devices in a structured way, allowing files to be read, written, and managed.
    • Device Drivers: Provide the necessary interfaces to communicate with hardware devices, translating OS-level commands into hardware-specific instructions.
  2. System Software:
    • Utilities: Programs that perform system maintenance tasks such as disk cleanup, data backup, and system diagnostics.
    • Libraries: Precompiled routines and functions that provide common services, allowing software to reuse code and access system resources more efficiently.
  3. Application Software:
    • Productivity Tools: Applications like word processors, spreadsheets, and database management systems, which allow users to perform specific tasks and manage data.
    • Multimedia Software: Applications for creating, editing, and viewing audio, video, and image files.
    • Web Browsers: Software for accessing and navigating the internet, rendering web pages, and managing network data.
  4. Development Software:
    • Compilers and Interpreters: Translate high-level programming languages into machine code or intermediate code that the computer can execute.
    • IDEs (Integrated Development Environments): Provide tools for writing, debugging, and testing software, streamlining the development process.
  5. Middleware:
    • APIs: Interfaces that allow different software components to communicate and share data.
    • Database Management Systems: Manage databases, allowing applications to store, retrieve, and manipulate data efficiently.
  6. Security Software:
    • Antivirus Programs: Detect and remove malicious software to protect data integrity and system security.
    • Encryption Tools: Secure data by encoding it, making it accessible only to authorized users.

Data Handling in Software

  1. Data Input and Output:
    • User Input: Software collects data from users through input devices like keyboards, mice, and touchscreens.
    • Data Output: Data is processed and presented to users through output devices like monitors, printers, and speakers.
  2. Data Processing:
    • Algorithms: Software uses algorithms to manipulate data, performing calculations, sorting, searching, and other tasks.
    • Data Storage and Retrieval: Data is stored in files, databases, or memory, and retrieved when needed for processing or analysis.
  3. Data Management:
    • File Systems: Organize data into files and directories, allowing for efficient storage and retrieval.
    • Databases: Provide structured storage for large amounts of data, supporting queries and transactions to manage and manipulate data effectively.
  4. Data Communication:
    • Networking Protocols: Software uses protocols to transmit data over networks, enabling communication between devices and systems.
    • Data Formats: Software supports various data formats (e.g., JSON, XML, CSV) for data exchange and interoperability between systems.

Software and Hardware Interaction

  1. Abstraction Layers:
    • Hardware Abstraction: Software abstracts hardware details, providing a consistent interface for applications to access hardware resources without needing to know the specifics of the hardware.
    • Virtualization: Software can create virtual environments that simulate hardware, allowing multiple software systems to run on the same physical hardware without interference.
  2. Resource Management:
    • Memory Management: The OS manages memory allocation for software applications, ensuring efficient use of RAM and preventing conflicts.
    • CPU Scheduling: The OS schedules processes and threads to run on the CPU, balancing load and optimizing performance.
  3. Software Execution:
    • Machine Code: The final output of compiled software, consisting of binary instructions that the CPU executes to perform tasks.
    • Process Management: The OS manages running applications (processes), allocating resources and managing execution states.

Evolution and Future Trends

  1. Cloud Computing:
    • Software as a Service (SaaS): Delivers software over the internet, allowing users to access applications from anywhere.
    • Cloud Storage: Provides scalable and flexible storage solutions, enabling software to store and manage data in the cloud.
  2. Artificial Intelligence:
    • Machine Learning: Software algorithms learn from data and make predictions or decisions based on that data.
    • Data Analytics: Software analyzes large datasets to uncover patterns, trends, and insights.
  3. Internet of Things (IoT):
    • Embedded Software: Runs on IoT devices, enabling them to collect data, interact with other devices, and perform tasks autonomously.
    • Edge Computing: Software processes data locally on IoT devices, reducing the need for centralized data processing and enabling faster response times.

Summary

Software acts as the intermediary between the user and the hardware, enabling the manipulation and management of data through various layers of abstraction. From operating systems that manage hardware resources to application software that performs specific tasks, software components work together to create a functional and efficient computing environment. Understanding these building blocks and their interactions is essential for comprehending how software transforms data into meaningful information and actionable insights.

What is a computer and where they can be found?

Mainframes

I apologize for using IBM as an example and not mentioning other companies and efforts that have occurred, but my professional life has been with IBM and it represents the main stream for the type of machine mentioned and when this is not the case, I will highlight other efforts.

Personal Computers

I did this post back in 2016 and the age is showing but basically it is still valid except that Apple concentrated and dominated Iphones and left a room that makes us believe that Microsoft Operating System based consumer level machines are Personal computers. It should be mentioned that there have been emulators that run Windows on a Mac as well as before then a simple file exchange program called Apple File Exchange that brought over PC formatted floppy disks and allowed them to be read on Macs. There even was an Intel CPU card that you could put in the Apple that allowed running Microsoft DOS based operating systems on the Mac, and an OrangeMicro Intel card that allowed Macs with PCI ports to run Windows on a 386 processor.

Fact of life is that Microsoft also makes collaboration and compatibility with other organizations run smoother what ended up that in the marketplace, Windows is the dominant operating system.

Fact of life also is that Microsoft incursions on the smartphone endeavour didn’t prosper and there is a blurred line defining how much the Iphone took over the personal computer and it is fair to imagine that eventually in the future it will take over and replace the personal computer for most of its use.

It is perhaps a good place to take a look how Microsoft took over IBM

Internet

There is a lot of computer programming to move Internet, perhaps to move computer programs through Internet, which is taking over our lives in almost all aspects of it.

Games and Personal Computers

There was a time, no so long ago that the line between games and home computers was blurred, because there was a perception that one of the uses of home computers would be gaming. But before the existence of what today in the Windows is the bundle the Office, you had to perform all these tasks some how

Areas where computers are used

Computers are vital in numerous fields, transforming how tasks are performed, improving efficiency, and enabling new capabilities. They play a crucial role in healthcare, finance, manufacturing, education, transportation, energy, entertainment, science, security, communication, retail, agriculture, construction, legal, and art, making them indispensable in modern society.

The previous introduction is a backdrop framing where computer programs actually do their thing. Let’s take a look how they started, their evolution and the scenario as it is today, at the beginning of this 21rst century: 

Machine Language

Machine language are the lowest level of software directly executable by a computer’s central processing unit (CPU). Machine language consists of binary code (1s and 0s) that the CPU can read and execute without the need for further translation or interpretation. Here’s an overview of machine language and its characteristics:

Characteristics of Machine Language:

  1. Binary Code: Instructions are written in binary, a base-2 numeral system consisting of only 0s and 1s.
  2. Machine code and binary are the same – a number system with base 2 – either a 1 or 0. But machine code can also be expressed in hex-format (hexadecimal) – a number system with base 16.
  3. Direct Execution: The CPU directly executes machine language instructions, making them the fastest in terms of execution speed.
  4. Hardware-Specific: Machine language is specific to a particular CPU architecture. Programs written for one type of CPU may not work on another without modification.
  5. Basic Instructions: Machine language provides a limited set of instructions for basic operations like arithmetic, data movement, and control flow.

Structure of Machine Language Programs:

  1. Opcode: The first part of a machine language instruction is the opcode (operation code), which specifies the operation to be performed (e.g., ADD, SUBTRACT, LOAD, STORE).
  2. Operands: The remaining parts of the instruction specify the operands, which can be registers, memory addresses, or immediate values.

Example of Machine Language:

Consider a simple machine language instruction for an imaginary CPU:

Copy code 10110011 00000101
  • Opcode: 1011 (which might represent a “LOAD” operation)
  • Operands: 0011 00000101 (which might specify a register and a memory address)

Advantages of Machine Language:

  1. Efficiency: Since machine language instructions are executed directly by the CPU, programs can be highly efficient and fast.
  2. Control: Programmers have precise control over the hardware, allowing for optimization of performance-critical applications.

Disadvantages of Machine Language:

  1. Complexity: Writing programs in machine language is extremely complex and error-prone due to the need to manage every detail manually.
  2. Portability: Machine language programs are not portable across different CPU architectures.
  3. Readability: Binary code is difficult to read and understand, making maintenance and debugging challenging.

Use Cases for Machine Language:

  1. Embedded Systems: In systems with limited resources, such as microcontrollers in embedded devices, machine language can be used to maximize performance.
  2. Bootloaders: Programs that need to execute immediately upon system startup, like bootloaders, may be written in machine language.
  3. Performance-Critical Code: Sections of programs that require maximum efficiency, such as certain routines in operating systems or real-time applications.

Transition to Higher-Level Languages:

While early computer programs were often written in machine language, the development of assembly language and higher-level programming languages (such as C, Python, and Java) has largely replaced the need for direct machine language programming. Higher-level languages provide abstraction, making programming more accessible, maintainable, and portable.

Assembly Language:

Assembly language serves as an intermediary between machine language and higher-level languages. It uses mnemonic codes and labels instead of binary, making it easier to read and write while still providing close control over hardware. An assembler translates assembly language code into machine language.

In my days, there was Assembler, which was the green card and the yellow card under which the 360/370 architecture was written and ther was machine code assembler, which was the particular machine which was loaded to furn gree/yellow cards 360/370 architecture programs. It seems to me that the assembled program with whatever machine code it is used now is generally called Assembly.

Example of Assembly Language:

An assembly language instruction equivalent to the earlier example might look like:

Copy code LOAD R3, 0x05
  • Opcode: LOAD (representing the load operation)
  • Operands: R3, 0x05 (specifying register R3 and memory address 0x05)

In summary, machine language is the most basic form of programming, consisting of binary code executed directly by the CPU. While powerful in terms of efficiency and control, it is complex and challenging to work with, leading to the widespread use of higher-level languages and assembly language for most programming tasks.

360/370 Assembler

Kent Aldershof former IBM employe sumarizes the impact of the introduction of the System 360 and its sequel the 370:

It was a bet-your-company, very risky, decision.

Preceding generations of IBM computers were backward-compatible. Programs developed for the 701 or the 704 would work with the 707 or 709, which were much more powerful machines. Some reprogramming was needed, but customers did not have to throw out their systems just to upgrade the machines. And data files, such as tapes, were compatible from one generation to the next.

Most earlier IBM computers were 36-byte word machines. The System 360 machines were designed around a 32-byte word. They had much greater computing capability, but it meant that entirely new operating programs had to be written. Customers who wanted the power and capabilities of the new machines had to have entirely new software. And reformat their data files.

The greatest appeal of the System 360 is that the machines were upward-compatible. That means a customer could acquire a faster, higher-memory machine in the line, but (with a couple of exceptions) all the programs for the smaller machine were transferrable to the larger machine — all the way up the line. That was not true for earlier IBM computers as one moved upward in size.

This is a rather oversimplified explanation of the changes and the problems, but I hope it will suffice to show that introduction of the System 360 was a real game changer. In one action, IBM obsoleted the entire installed base of its computer equipment. There was enormous risk and uncertainty that customers would be willing to essentially do their entire IT systems over, to be able to take advantage of the new generation of machines.

Fortunately for IBM, and for IBM stockholders, it worked. It took an enormous marketing and sales effort, and immense technical support, but the System 360 machines were a sufficient advancement in capability — at a time when data processing power was becoming a major bottleneck for many companies — that the majority of customers bit the bullet, and the System 360 machines, and their successors, enjoyed huge sales.

The computer industry at that time was known as “IBM and the Seven Dwarfs” — with competitors such as Univac and Burroughs far behind IBM. After the System 360 was introduced, most of the Seven Dwarfs either merged or were bought up, or retreated into specialized market niches. It cemented IBM’s market lead for the next 10 or 20 years.

green-reference-card-for-360-acrchitectureDownload

The original reference card for the IBM System/360 assembler was indeed green or blue in its first versions. Here is a more accurate summary reflecting this historical detail:

The IBM System/360 Assembler Reference Card:

The IBM System/360 assembler reference card, initially issued in green or blue, was a vital tool for programmers working with IBM’s System/360 mainframe computers.

Key Features:

  1. Instruction Set: The card provided a comprehensive list of machine instructions, including opcodes, mnemonics, and brief descriptions of each instruction’s function.
  2. Syntax and Format: It detailed the syntax and format for assembler instructions, covering the correct structure of code, operand usage, and addressing modes.
  3. Registers and Storage: Information on general-purpose and special-purpose registers, along with memory storage conventions, was included to aid in data management and resource utilization.
  4. Assembler Directives: The card listed assembler directives (pseudo-operations) that controlled the assembly process, facilitating tasks such as defining constants, reserving storage, and managing flow control.
  5. System Macros: Commonly used system macros and their usage were provided to streamline standard operations and tasks.
  6. Character Codes and Conversion Tables: Tables for EBCDIC character codes were included, essential for data manipulation and character processing on IBM mainframes.

Importance:

  • Quick Reference: Served as a quick reference, allowing programmers to look up instructions and syntax efficiently.
  • Error Reduction: Helped reduce coding errors by providing accurate, concise information.
  • Learning Tool: A valuable educational resource for new programmers learning the IBM System/360 assembler language.

Legacy:

The green or blue reference card for the IBM System/360 assembler exemplifies the evolution of programming tools, highlighting the necessity for efficient and accessible documentation in the early days of computing. It is a testament to the advancements in programming environments and tools over time.

In summary, the original green or blue IBM System/360 assembler reference card was a critical resource, enhancing the productivity and accuracy of programmers working with IBM’s mainframe systems.

The IBM System/370 Assembler Reference Card:

yellow-gx20-1850-7_system_370_reference_summary_feb89Download

A general overview of what represented the introduction of the 360 system by IBM can be read in more detail at Early Computer.com IBM page, from which I quote and summarize the impact it had: 

“When the IBM System/360 was announced in 1964, the worldwide inventory of installed computers was estimated to be about $10 billion of wich IBM had about $7 billion. Five years later IBM’s worldwide inventory had increased more than three fold to approximately $24 billion (73%) and the rest of the suppiers had about $9 billion (27%).”

IBM System 370 improvements over the System 360.

the IBM System/360 and System/370 series were designed to be largely compatible across different machines within each series, thanks to a common architecture. Here’s a more detailed explanation:

IBM System/360 and System/370 Compatibility

  1. Common Architecture: Both the System/360 and System/370 series were designed with a unified architecture, which means they shared a common instruction set and system design principles. This allowed programs written for one model in the series to be run on another model with little or no modification.
  2. Assembler Language: Each system had its own assembler language tailored to its specific features and capabilities, but these assemblers were designed to produce machine code that adhered to the common architecture. As a result, assembly programs written for one machine could often be assembled and run on another machine in the series, provided the assembler accommodated any model-specific features or extensions.
  3. Cross-Model Compatibility:
    • System/360: Introduced in the 1960s, the System/360 series was revolutionary for its time, providing a consistent computing environment across different models with varying performance and capabilities.
    • System/370: Introduced in the 1970s, the System/370 series maintained compatibility with System/360 while adding new features and performance improvements. This backward compatibility was a significant advantage for customers, allowing them to upgrade hardware without rewriting or significantly altering existing software.
  4. Assemblers and Tools:
    • System/360 Assembler: The assembler for System/360 was designed to work with the System/360 instruction set, allowing programmers to write code that would run on any System/360 model.
    • System/370 Assembler: Similarly, the System/370 assembler supported the System/370 instruction set, which included enhancements over System/360 but maintained backward compatibility. Programs written for System/360 could often be reassembled with the System/370 assembler and run on a System/370 machine.
  5. Macro Assemblers: Both series used macro assemblers that supported high-level macros, making it easier to write and manage complex code. These macros could be used to write code that was more portable across different models within the series.
  6. System Software: IBM provided system software, including operating systems like OS/360 and OS/370, which managed hardware resources and provided a consistent programming interface across different models.

Practical Implications

  • Portability: Programs written for the System/360 or System/370 could be ported between models with minimal changes, preserving software investments.
  • Scalability: Organizations could scale their computing power by upgrading to more powerful models within the same series without needing to replace their entire software stack.
  • Longevity: The common architecture and backward compatibility extended the useful life of software, reducing costs associated with rewriting or redeveloping applications for new hardware.

Summary

While each model within the IBM System/360 and System/370 series had its own specific assembler and set of features, the underlying architectural compatibility ensured that programs could run across different models with relative ease. This architectural consistency was a key factor in the success and widespread adoption of these mainframe systems.

How System 360 became possible

Either in the Green Card or the Yellow card each command (or instruction) in assembly language for systems like the IBM System/360 and System/370 is implemented using microprogramming. This means that each comand either for the green card or the yellow card is microprogrammed for each specific machine in its own unique assembler. A more detailed explanation of how this works:

Microprogramming and Assembly Language

1. Assembly Language Instructions

  • High-Level Representation: Assembly language instructions are a human-readable representation of the machine code instructions that the CPU executes directly.
  • System-Specific: The instruction set is specific to a particular computer architecture. For IBM’s System/360 and System/370, this means that instructions are tailored to the hardware of these systems as of the particular machine size.

2. Microprogramming

  • Definition: Microprogramming is a layer of abstraction below machine code, where each machine code instruction is implemented as a sequence of simpler, more fundamental operations called micro-operations.
  • Microcode: A set of microinstructions that define how a specific machine code instruction is executed by the hardware. It is stored in a special memory inside the CPU.

3. IBM System/360 and System/370

  • Green Card and Yellow Card: These were reference cards for IBM assembly programmers, listing the available machine instructions for the System/360 (Green Card) and System/370 (Yellow Card).
    • Green Card: Used for IBM System/360 instructions.
    • Yellow Card: Used for IBM System/370 instructions.

How It Works

  1. Instruction Encoding
    • Each assembly language instruction corresponds to a specific machine code instruction, which consists of an opcode and possibly operands.
  2. Microcode Execution
    • Instruction Fetch: The CPU fetches the machine code instruction from memory.
    • Instruction Decode: The instruction is decoded to determine the appropriate sequence of micro-operations.
    • Micro-Operation Execution: The microcode executes these micro-operations, which involve basic tasks like moving data between registers, performing arithmetic operations, and controlling the ALU.
  3. Machine-Specific Microprogramming
    • Unique Microcode: Each machine in the System/360 or System/370 series may have different implementations for the same assembly instructions, as their microcode is tailored to the specific hardware capabilities of each model.
    • Microcode Variations: Microcode can vary significantly between different models, allowing for optimizations that leverage specific hardware features like faster memory access or additional registers.

Benefits of Microprogramming

  1. Flexibility: Microprogramming allows for complex instructions to be implemented efficiently and enables compatibility across different models by standardizing high-level machine code while allowing hardware-specific optimizations.
  2. Simplified Hardware Design: Complex operations can be broken down into simpler micro-operations, reducing the need for intricate hardware circuits for each high-level instruction.
  3. Easier Modifications: Changes and optimizations can be made at the microcode level without altering the physical hardware.

Practical Example

Example Instruction Execution

  • Assembly Instruction: ADD R1, R2 (adds the contents of register R2 to register R1)
  • Micro-Operation Sequence:
    • Fetch the contents of R2.
    • Pass the contents to the ALU.
    • Perform the addition with the contents of R1.
    • Store the result back into R1.

Each of these steps is implemented by specific micro-operations controlled by the microcode.

Modern Context

While microprogramming is still relevant in some CPU designs, many modern processors use hardwired control for basic operations to enhance speed. However, microprogramming remains an essential concept in understanding how complex instruction sets can be efficiently implemented and supported across different hardware platforms.

Conclusion

In summary, each command in assembly language for the IBM System/360 and System/370 is indeed microprogrammed for each specific machine, with its own unique set of microcode instructions that control how the hardware executes the command. This approach allows for flexibility, compatibility, and optimization across different hardware configurations.

————————————————————–

Computer Programs and how they fitted in

A computer program is a set of instructions that a computer follows to perform specific tasks. These instructions are written in a programming language, which can be understood by the computer’s hardware and software. Computer programs can range from simple scripts that perform basic operations to complex systems that manage large-scale applications.

Key Components of a Computer Program:

  1. Code: The written instructions in a programming language.
  2. Algorithms: Step-by-step procedures or formulas for solving problems.
  3. Data Structures: Ways to organize and store data to be efficiently accessed and modified.
  4. Functions/Methods: Blocks of code designed to perform specific tasks, which can be reused.
  5. Variables: Storage locations that hold data values.
  6. Control Structures: Constructs that control the flow of execution, such as loops and conditionals (if-else statements).

Types of Computer Programs:

  1. System Software: Programs that manage and support a computer’s basic functions, such as operating systems (e.g., Windows, Linux, macOS).
  2. Application Software: Programs designed to perform specific tasks for users, such as word processors, web browsers, and games.
  3. Utility Software: Programs that perform maintenance tasks, such as antivirus software and disk cleanup tools.
  4. Embedded Software: Programs that control devices other than computers, such as smart TVs, cars, and industrial machines.

Programming Languages:

Programs can be written in various programming languages, each suited for different types of tasks. Some common programming languages include:

  • Python: Known for its readability and simplicity, often used for web development, data analysis, and scripting.
  • Java: A versatile language commonly used for building enterprise-scale applications and Android apps.
  • C/C++: Powerful languages used for system programming, game development, and applications requiring high performance.
  • JavaScript: Primarily used for web development to create interactive websites.
  • Ruby: Known for its simplicity and productivity, often used in web development with the Ruby on Rails framework.

How a Program Works:

  1. Writing Code: A programmer writes code in a text editor or an Integrated Development Environment (IDE).
  2. Compiling/Interpreting: The code is then compiled (converted into machine language) or interpreted (executed line by line) by a language processor.
  3. Execution: The compiled or interpreted code is executed by the computer’s processor, which performs the specified tasks.
  4. Output: The program produces output, which can be displayed on the screen, stored in a file, sent over a network, etc.

Examples of Computer Programs:

  • Web Browsers: Programs like Google Chrome and Firefox that allow users to access and navigate the internet.
  • Office Suites: Programs like Microsoft Office or Google Workspace that provide tools for document creation, spreadsheets, and presentations.
  • Media Players: Programs like VLC and iTunes that play audio and video files.
  • Games: Programs designed for entertainment, ranging from simple puzzles to complex, immersive environments.

In summary, a computer program is a carefully designed sequence of instructions that tells a computer how to perform tasks, from simple calculations to complex data processing and interactive applications.

Higher-level languages are typically written in a set of instructions that abstract away from the specific machine instructions of the underlying hardware. These high-level instructions are then translated into machine code that the CPU can execute, through a process called compilation or interpretation. Here’s an overview of how this process works:

From High-Level Languages to Machine Code

  1. High-Level Languages:
    • Examples: C, C++, Java, Python, etc.
    • Characteristics: High-level languages provide abstractions that are closer to human language and further from machine code. They offer constructs like variables, loops, conditionals, functions, and objects.
    • Purpose: These languages make it easier for programmers to write complex programs without dealing with the intricacies of the underlying hardware.
  2. Compilation:
    • Compiler: A compiler is a special program that translates high-level language code into machine code (binary instructions that the CPU can execute directly).
    • Intermediate Representation: During compilation, the source code is often translated into an intermediate representation (IR) before being converted into machine code. Examples of IR include assembly language and bytecode.
    • Target Machine Code: Finally, the IR is translated into machine code specific to the target CPU architecture (e.g., x86, ARM).
  3. Interpretation:
    • Interpreter: An interpreter directly executes the instructions written in a high-level language without translating them into machine code beforehand. Instead, it reads and executes the code line by line.
    • Bytecode Interpretation: Some languages, like Python and Java, compile source code into bytecode, which is an intermediate form. This bytecode is then executed by a virtual machine (e.g., the Java Virtual Machine).
  4. Assembly Language:
    • Assembler: An assembler is a program that translates assembly language (a low-level language that is closely related to machine code) into machine code.
    • Assembly Instructions: Assembly language provides a human-readable way to write machine instructions. Each assembly instruction corresponds closely to a specific machine instruction.

Example of the Process

Let’s take an example of how a simple high-level language program is processed:

High-Level Language Code (C):

Copy code main() {
    int a = 5;
    int b = 10;
    int c = a + b;
    return c;
}

Compilation Process:

1.Source Code: The C code is written by the programmer.

2.Compiler: The compiler translates the C code into an intermediate representation (IR), such as assembly language or bytecode.

3.Assembly Code: assembly

Example of assembly code for the C program

MOV EAX, 5
MOV EBX, 10
ADD EAX, EBX
MOV ECX, EAX

4.Machine Code: The assembler translates the assembly code into machine code (binary instructions).

binary example code

10111000 00000101 ; MOV EAX, 5
10111011 00001010 ; MOV EBX, 10
00000001 11000011 ; ADD EAX, EBX
10001001 11000000 ; MOV ECX, EAX

Summary

Higher-level languages are written in human-readable instructions that abstract away the complexity of the machine. These instructions are translated into machine code through compilation or interpretation. The process involves converting high-level language code into an intermediate representation and finally into machine code that the CPU can execute. This layered approach allows programmers to write code that is portable, easier to understand, and maintainable while ensuring it can run efficiently on the target hardware.

You have a specific compiler depending on which machine you are going to run you high level program.the specific compiler you use can depend on the target machine (i.e., the hardware and operating system) where you intend to run your high-level program. Here’s how this works in detail:

Platform-Specific Compilers

  1. Computer Architecture
  2. Target Architecture:
    • Different CPUs have different instruction sets (e.g., x86, ARM). A compiler must generate machine code that is compatible with the target CPU’s instruction set.
    • Examples:
      • GCC (GNU Compiler Collection) can generate code for multiple architectures, including x86, ARM, MIPS, and more.
      • Clang (part of the LLVM project) also supports a variety of target architectures.
  3. Operating System:
    • Different operating systems (e.g., Windows, macOS, Linux) have different system calls, libraries, and conventions.
    • A compiler may need to link against different system libraries and generate code that adheres to the OS’s conventions.
    • Examples:
      • Microsoft Visual Studio Compiler (MSVC) targets Windows.
      • GCC and Clang can target multiple operating systems with appropriate configurations.
  4. Cross-Compilation:
    • Sometimes, you may want to compile code on one type of machine but run it on another. This is called cross-compilation.
    • Cross-compilers are compilers configured to generate machine code for a different architecture/OS than the one they are running on.
    • Example: Using a cross-compiler to generate ARM machine code on an x86 Linux system for deployment on an ARM-based embedded device.

Example Scenario

Suppose you have a C program and you want to run it on different platforms. Here’s how you might proceed:

Code Example (C):

cCopy códe#include <stdio.h>

int main() {
    printf("Hello, World!\n");
    return 0;
}

Compiling for Different Targets:

  1. Linux on x86:
    • Compiler: GCC
    • Command: gcc -o hello hello.c
    • Output: An executable binary that runs on x86 Linux.
  2. Windows on x86:
    • Compiler: MSVC or MinGW (GCC for Windows)
    • Command (MSVC): cl hello.c
    • Command (MinGW): gcc -o hello.exe hello.c
    • Output: An executable binary that runs on x86 Windows.
  3. macOS on x86:
    • Compiler: Clang (default on macOS)
    • Command: clang -o hello hello.c
    • Output: An executable binary that runs on x86 macOS.
  4. Embedded ARM Device:
    • Compiler: ARM GCC cross-compiler
    • Command: arm-none-eabi-gcc -o hello hello.c
    • Output: An executable binary for an ARM-based embedded system.

Conclusion

While you write your high-level code once, you may need to use different compilers or different configurations of the same compiler to generate the appropriate machine code for your target platform. This ensures that your code can run correctly and efficiently on the intended hardware and operating system.

Historically

First high-level languages which were invented, such as FORTRAN, were built in a similar manner, where compilers were designed to translate the high-level code into machine code that could run on specific target architectures and operating systems. Here’s how it worked for some of the early high-level languages:

FORTRAN (Formula Translation)

Development Context:

  • Introduced: 1957 by IBM
  • Purpose: Designed for scientific and engineering calculations

Compilation Process:

  • High-Level Code: Written in FORTRAN
  • Compiler: The FORTRAN compiler translates FORTRAN code into assembly or machine code specific to the target machine.
  • Target Machine: Initially the IBM 704, but later versions supported other IBM mainframes like the IBM 7090 and IBM System/360.

Example:

fortran Copiar código      PROGRAM HELLO
      PRINT *, 'HELLO, WORLD!'
      END

Compilation:

  • Command: Varies by platform. For example, fortran hello.f on some systems.
  • Output: Machine code specific to the IBM 704, or whichever system the compiler was targeting.

COBOL (Common Business-Oriented Language)

Development Context:

  • Introduced: 1959
  • Purpose: Designed for business data processing

Compilation Process:

  • High-Level Code: Written in COBOL
  • Compiler: COBOL compilers translate COBOL code into assembly or machine code for the target system.
  • Target Machines: Initially, large IBM mainframes and later other business-oriented systems.

Example:

cobolCopiar códigoIDENTIFICATION DIVISION.
PROGRAM-ID. HELLO.
PROCEDURE DIVISION.
    DISPLAY 'HELLO, WORLD!'.
    STOP RUN.

Compilation:

  • Command: Varies by platform. For example, cobc -x hello.cob for the GnuCOBOL compiler.
  • Output: Executable machine code for the target system.

General Compilation Process for Early High-Level Languages

  1. Source Code: The programmer writes code in a high-level language like FORTRAN, COBOL, or LISP.
  2. Compiler: The compiler is designed specifically for the target machine. It reads the high-level source code and translates it into the assembly language or machine code of the target system.
  3. Assembly Language (Optional): Some compilers might first translate high-level code into an intermediate assembly language specific to the target machine.
  4. Machine Code: The final output is machine code that the hardware can execute directly.

Portability and Machine-Specific Compilers

Initially, each high-level language required a separate compiler for each type of machine. For example:

  • FORTRAN compilers were developed for various IBM systems and other mainframes.
  • COBOL compilers were tailored for business-oriented systems.
  • Each compiler generated machine code tailored to the architecture and operating system of the target machine.

Evolution Towards Cross-Platform Compilers

Over time, the need for portability led to the development of cross-compilers and the adoption of standard language specifications. This evolution aimed to make high-level code more portable across different systems, allowing a single source code base to be compiled for multiple target platforms with appropriate compiler configurations.

In summary, the early high-level languages like FORTRAN, COBOL, and others were indeed compiled in a manner specific to the target architecture and operating system, much like modern high-level languages. This approach enabled them to harness the capabilities of various computing systems available at the time.

What happened to them?  

The first high-level programming languages were developed to simplify programming, making it more accessible and efficient compared to low-level assembly languages. Here are some of the earliest high-level languages, their purposes, and reasons why they were eventually abandoned or evolved:

1. FORTRAN (Formula Translation)

Introduced: 1957 by IBM Purpose: Designed for scientific and engineering calculations Features:

  • Efficient handling of numerical computations
  • Support for complex mathematical expressions
  • Early use of compiled code for performance

Reason for Decline:

  • Evolved rather than abandoned; modern versions like Fortran 90/95/2003 are still used, but its dominance has waned with the rise of other languages like Python and MATLAB that offer easier syntax and more features for scientific computing.

2. COBOL (Common Business-Oriented Language)

Introduced: 1959 Purpose: Designed for business data processing Features:

  • English-like syntax for readability
  • Strong support for file handling and record processing

Reason for Decline:

  • Still in use, especially in legacy business systems, but less popular for new projects due to the rise of more modern languages like Java, C#, and SQL which offer better support for modern development practices and technologies.

3. LISP (List Processing)

Introduced: 1958 by John McCarthy Purpose: Designed for artificial intelligence research Features:

  • Highly flexible and dynamic
  • Support for symbolic computation
  • Recursion and conditional expressions

Reason for Decline:

  • LISP and its dialects (like Common Lisp and Scheme) are still used in AI and academic research, but mainstream use has declined due to the complexity of syntax and the rise of languages like Python and JavaScript that are seen as more user-friendly and versatile for various applications.

4. ALGOL (Algorithmic Language)

Introduced: 1958 Purpose: Designed for scientific research and algorithm description Features:

  • Block structure for organizing code
  • Influenced many subsequent languages (e.g., Pascal, C)

Reason for Decline:

  • Lacked standardization and commercial support
  • Superseded by descendants like Pascal and C, which offered improvements in usability, performance, and system programming capabilities.

5. BASIC (Beginner’s All-purpose Symbolic Instruction Code)

Introduced: 1964 by John Kemeny and Thomas Kurtz Purpose: Designed for education and ease of use Features:

  • Simple syntax for beginners
  • Immediate execution of commands (interpreter-based)

Reason for Decline:

  • Evolved into more structured and powerful dialects like Visual Basic
  • Replaced by languages offering better support for modern programming paradigms, like Python and JavaScript.

6. APL (A Programming Language)

Introduced: 1966 by Kenneth Iverson Purpose: Designed for mathematical notation and array processing Features:

  • Concise and expressive syntax for mathematical operations
  • Powerful array manipulation capabilities

Reason for Decline:

  • Steep learning curve due to its unique symbols and syntax
  • Niche applications, overshadowed by languages like MATLAB and R for mathematical and statistical computing.

7. PL/I (Programming Language One)

Introduced: 1964 by IBM Purpose: Intended to combine features of scientific and business languages Features:

  • Rich set of features for various applications
  • Exception handling and multitasking support

Reason for Decline:

  • Overly complex and difficult to learn
  • Superseded by more specialized and streamlined languages like C and its derivatives for system programming and business applications.

Summary

Many of these early high-level languages laid the foundation for modern programming but were eventually overshadowed by languages that offered:

  • Improved readability and simplicity (e.g., Python)
  • Better support for modern development practices (e.g., Java, C#)
  • Enhanced performance and system-level access (e.g., C, C++)

While some of these languages are still in use today, especially in legacy systems and specific domains, their mainstream popularity has declined as newer languages have emerged to meet the evolving needs of the software development industry.

Most popular high level languages and to what purpose today (2024)

As of today, several high-level programming languages are popular, each suited to different purposes and domains. Here is an overview of some of the most popular high-level languages and their primary uses:

1. Python

Purpose:

  • General-purpose programming
  • Data science and machine learning
  • Web development
  • Automation and scripting
  • Scientific computing

Features:

  • Easy-to-read syntax
  • Extensive standard library and third-party packages (e.g., NumPy, pandas, TensorFlow)
  • Strong community support

2. JavaScript

Purpose:

  • Web development (frontend and backend)
  • Interactive web applications
  • Server-side development with Node.js
  • Mobile app development (using frameworks like React Native)

Features:

  • Runs in web browsers
  • Asynchronous programming with promises and async/await
  • Extensive ecosystem (e.g., frameworks like React, Angular, Vue.js)

3. Java

Purpose:

  • Enterprise-level applications
  • Android app development
  • Web development (using frameworks like Spring)
  • Backend services

Features:

  • Platform independence (Write Once, Run Anywhere)
  • Strong type system and object-oriented programming
  • Robust standard library and frameworks

4. C#

Purpose:

  • Windows application development
  • Web development with ASP.NET
  • Game development with Unity
  • Enterprise software

Features:

  • Integrated with the Microsoft ecosystem
  • Powerful features for modern programming (e.g., LINQ, async/await)
  • Strong support for object-oriented programming

5. C++

Purpose:

  • System and application software
  • Game development
  • Performance-critical applications
  • Embedded systems

Features:

  • High performance and control over system resources
  • Supports both high-level and low-level programming
  • Extensive use in game engines and real-time simulations

6. PHP

Purpose:

  • Web development
  • Server-side scripting
  • Content management systems (e.g., WordPress)

Features:

  • Wide use in web development
  • Integrates easily with HTML and databases
  • Large ecosystem of frameworks and tools (e.g., Laravel)

7. Swift

Purpose:

  • iOS and macOS application development

Features:

  • Modern, safe, and fast
  • Strongly integrated with Apple’s development environment (Xcode)
  • Easy to read and maintain

8. Ruby

Purpose:

  • Web development
  • General-purpose scripting

Features:

  • Focus on simplicity and productivity
  • Popular for web development with the Ruby on Rails framework
  • Dynamic and object-oriented

9. R

Purpose:

  • Statistical computing
  • Data analysis
  • Data visualization

Features:

  • Extensive libraries for statistics and data analysis
  • Strong support for data visualization (e.g., ggplot2)
  • Widely used in academia and research

10. Go (Golang)

Purpose:

  • System and network programming
  • Backend services
  • Cloud computing

Features:

  • Simple and efficient concurrency model
  • Strong performance and scalability
  • Developed by Google with strong support for modern development needs

11. Kotlin

Purpose:

  • Android app development
  • Backend development

Features:

  • Fully interoperable with Java
  • Modern language features (e.g., null safety, coroutines)
  • Official language for Android development

Summary

These languages are popular due to their strengths and the specific needs they address in various domains. Here’s a quick summary of their main applications:

  • Python: Versatile, especially strong in data science and AI.
  • JavaScript: Essential for web development, both frontend and backend.
  • Java: Enterprise applications, Android apps.
  • C#: Windows applications, web services, games.
  • C++: Performance-critical applications, systems programming, games.
  • PHP: Server-side web development.
  • Swift: iOS and macOS development.
  • Ruby: Web development, particularly with Rails.
  • R: Statistical analysis and data visualization.
  • Go: Efficient system-level programming and cloud services.
  • Kotlin: Modern Android app development.

Each of these languages has a strong community and a rich ecosystem of libraries and frameworks, making them suitable for their respective domains and helping developers build efficient, scalable, and maintainable applications.

The future

I asked Chat GPT4: Can you program in any of these languages?

The answer was: As an AI developed by OpenAI, I can provide assistance and generate code snippets in many of the popular programming languages listed earlier. Here are examples of simple programs in each language to demonstrate:

How I Can Help

  • Code Generation: I can help generate code snippets, provide explanations, and assist with various programming tasks in these languages.
  • Debugging: I can help identify and fix bugs in your code.
  • Learning: I can explain concepts and provide examples to help you learn these languages.
  • Optimization: I can suggest ways to optimize and improve your code.

If you have specific programming tasks, questions, or need more detailed code examples, feel free to ask!

Last paragraph was posted as “Future” but actually, as of begin of 2024 is available, meaning that the future already started. Actually the help AI provides is more in coding, specially debugging, and is a tool which saves time in programming environments, such as this example, which seems to me very much welcomed, thinking of when we did that in the seventies and eighties, when there was a lot of menial tasks that were tiring, boring and time consuming which you had to do yourself, using “elbow grease”.

It is quite impressive when you see AI providing ready made or helping strongly to write programs in modern languages such as Python, Java, C++, etc. but it is not the same case when it comes to assembler and here are the limitations as of today which I hope will be overcome: 

Chat GPT 4 limitations when it comes to assembler

There are a few key limitations when it comes to providing assistance with IBM 360/370 assembler compared to more modern programming languages like Java, Python, or C++. Here are some of the main points:

Key Limitations

  1. Niche Knowledge:
    • Historical and Specialized: IBM 360/370 assembler is quite specialized and considered a legacy language, primarily used in specific industries and systems that require mainframe operations. My training data contains less detailed information on such niche and legacy technologies compared to more widely used modern languages.
  2. Practical Execution:
    • No Execution Environment: I cannot execute or test 360/370 assembler code directly. My capabilities are limited to generating and providing examples, explanations, and guidance based on theoretical knowledge and historical documentation.
  3. Up-to-date Practices:
    • Outdated Context: Modern programming languages and environments are frequently updated, and I have extensive information on current best practices, tools, and libraries. In contrast, the most up-to-date practices for 360/370 assembler are less likely to be as well-documented in recent literature or training data.
  4. Limited Contextual Information:
    • Less Detailed Documentation: Compared to modern languages that have extensive online documentation and community support, detailed information and tutorials on IBM 360/370 assembler can be more limited and harder to find.

Assistance I Can Provide for IBM 360/370 Assembler

  1. Basic Code Examples:
    • I can generate simple IBM 360/370 assembler code snippets and provide examples for basic operations like arithmetic, loops, and branching.
  2. Conceptual Explanations:
    • I can explain fundamental concepts, such as how to use registers, memory addressing, and common instructions in the IBM 360/370 assembler.
  3. Syntax and Instructions:
    • I can help with understanding the syntax and usage of common IBM 360/370 assembler instructions, such as L (Load), A (Add), ST (Store), and others.
  4. Legacy System Support:
    • I can offer general advice on working with legacy systems and suggest strategies for maintaining or migrating code written in IBM 360/370 assembler.

Example: Simple IBM 360/370 Assembler Code

Here’s a basic example of a 360/370 assembler code snippet for a simple task:

Addition of Two Numbers

assembly Copycode         START  0
         USING  *,15
MAIN     LR     15,0          /* Load register 15 with the current address */
         L      1,NUMBER1     /* Load the value at NUMBER1 into register 1 */
         L      2,NUMBER2     /* Load the value at NUMBER2 into register 2 */
         AR     1,2           /* Add the value in register 2 to register 1 */
         ST     1,RESULT      /* Store the result in memory location RESULT */
         END
NUMBER1  DC     F'10'         /* Define constant 10 */
NUMBER2  DC     F'20'         /* Define constant 20 */
RESULT   DS     F             /* Define storage for the result */
         END   MAIN

Summary

While I can help you understand and write basic code in IBM 360/370 assembler, provide explanations, and offer guidance based on available knowledge, my capabilities are more limited compared to more modern and widely-used programming languages. For more complex tasks or detailed system-specific issues, additional resources or expertise in mainframe systems may be required.

Artificial Intelligence programming (Chat GPT)

In its own words:

As an AI developed by OpenAI, I am not programmed in a traditional sense using a single language, but rather built using a complex combination of technologies and methodologies. Here’s a detailed breakdown of the components and languages involved in creating me:

Core Components and Technologies

  1. Machine Learning Frameworks:
    • Python: The primary language used for developing machine learning models. It provides libraries and frameworks like TensorFlow and PyTorch, which are essential for training and deploying deep learning models.
    • PyTorch: A popular deep learning framework used for building and training neural networks. It’s known for its flexibility and ease of use in research and production environments.
    • TensorFlow: Another widely used deep learning framework that supports a variety of machine learning tasks, from image recognition to natural language processing.
  2. Training Data and Preprocessing:
    • Data Handling: Python, along with libraries like Pandas and NumPy, is used to handle, preprocess, and manipulate large datasets required for training.
    • Natural Language Processing (NLP): Techniques for tokenization, stemming, lemmatization, and vectorization are implemented in Python using libraries like NLTK and SpaCy.
  3. Model Training:
    • High-Performance Computing: Training models requires powerful hardware like GPUs and TPUs, which are programmed using low-level languages like CUDA (for NVIDIA GPUs) or specialized frameworks.
    • Distributed Computing: Languages and frameworks for managing distributed training across multiple servers include Python-based tools like Ray or Horovod.
  4. Model Architecture:
    • Transformer Models: The underlying architecture, such as the GPT (Generative Pre-trained Transformer), is implemented using deep learning frameworks that support attention mechanisms and large-scale training.
    • BERT, GPT: The architecture of models like BERT or GPT involves complex neural networks, primarily constructed and trained using Python frameworks like PyTorch or TensorFlow.
  5. Deployment and Serving:
    • Inference Engines: Python and C++ are often used to create inference engines that optimize and deploy trained models for real-time predictions.
    • APIs and Microservices: Languages like Python, Go, and Node.js are used to create APIs and microservices that allow interaction with the AI model over the web.
  6. Software Engineering and Systems:
    • Backend Systems: For handling requests, data storage, and model management, languages like Python, Java, and C++ are used.
    • Data Storage: SQL and NoSQL databases (e.g., PostgreSQL, MongoDB) manage the data required for training and deploying AI models.
    • Infrastructure: Tools like Docker for containerization and Kubernetes for orchestration, with configuration often handled using languages like YAML or scripting languages like Bash.
  7. Optimization and Tuning:
    • Performance Tuning: Low-level languages like C++ or C are sometimes used for optimizing critical components to enhance performance.
    • Hyperparameter Tuning: Python is used extensively for setting up and executing experiments to find the best model parameters.

Summary

In summary, the development of an AI like me involves a combination of languages and technologies, with Python being the primary language for model development, training, and deployment. Other languages like C++, Java, and various scripting languages play crucial roles in different aspects of the system, from backend infrastructure to optimization and scaling.

How to approach Artificial Intelligence

The Constitution View under Material Constitution and computer programs

/ Roque E. de Campos / Deixe um comentário

Original use of the idea

In the context of material constitution in philosophy, the “constitution view” is a theory about the relationship between objects and the matter that constitutes them. This view seeks to explain how objects can be distinct from, yet closely related to, the material substances that make them up. Here’s a detailed overview of the constitution view:

Basic Idea

The constitution view posits that an object is constituted by its material components, but it is not identical to them. For example, a statue and the lump of clay that constitutes it are different entities, even though they share the same material.

Key Concepts

  1. Constitution Without Identity: According to the constitution view, an object (like a statue) is not identical to the material that constitutes it (like the lump of clay). The statue and the clay are two different things that occupy the same space and time, but they have different properties and can exist independently in some sense.
  2. Distinct Properties: The object and its constituent material can have different properties. For example, the statue has aesthetic properties (it represents something, it is beautiful), while the lump of clay has purely physical properties (mass, chemical composition).
  3. Persistence Conditions: The conditions under which an object continues to exist can differ from those of the material that constitutes it. For instance, if the statue is smashed and the clay is reformed into a different shape, the original statue no longer exists, but the lump of clay does.

Examples

  • Statue and Clay: The classic example used to illustrate the constitution view is that of a statue and the lump of clay from which it is made. The lump of clay could exist without being a statue (e.g., if it is just a lump), and the statue could be destroyed while the clay remains.
  • Paper and Money: Consider a piece of paper that constitutes a dollar bill. The dollar bill has properties like value and purchasing power, which the piece of paper, in itself, does not have.

Philosophical Implications

  1. Ontological Distinctions: The constitution view allows philosophers to make sense of how different kinds of objects can exist and persist over time, even when they share the same matter.
  2. Modal Properties: This view helps in understanding modal properties (possibilities and necessities) of objects. For example, the statue could not have been made of bronze without being a different statue, but the lump of clay could have been a different shape entirely.
  3. Problem of Material Coincidence: The constitution view addresses the problem of material coincidence, which questions how two objects (the statue and the clay) can occupy the same space at the same time without being identical.

Challenges and Alternatives

The constitution view faces challenges, such as:

  • Identity Conditions: How do we precisely determine when one object constitutes another, and under what conditions does this constitution change?
  • Alternative Views: Other theories, such as mereological essentialism (where objects are identical to their parts) or nihilism (denying the existence of composite objects), provide different solutions to the issues of material constitution.

Conclusion

The constitution view provides a nuanced way of understanding how objects relate to their material constituents. It helps to explain how objects can be more than just the sum of their parts and how they can possess different properties and persistence conditions from the matter that constitutes them. This view is significant in metaphysics and philosophy of language, offering insights into the nature of objects, identity, and persistence.

Constitution View and computer programs

Extending the constitution view to immaterial things like computer programs is an intriguing idea. The constitution view, traditionally applied to material objects, can indeed offer a framework for understanding the relationship between a program and its behavior, especially when the behavior includes unintended outputs. Here’s how we might adapt the constitution view to immaterial entities:

Constitution View Applied to Computer Programs

Basic Idea

Just as the constitution view posits that a material object (like a statue) is constituted by its physical material (like clay) but is not identical to it, we can similarly posit that a computer program is constituted by its code but is not identical to it. The program’s behavior, including its outputs, emerges from the code but is not reducible to it.

Key Concepts

  1. Constitution Without Identity: The program (as an abstract entity) is not identical to the lines of code written by programmers. The code is the medium through which the program exists, but the program itself includes the dynamic processes and behaviors that arise when the code is executed.
  2. Distinct Properties: The code has syntactic and structural properties (e.g., the arrangement of instructions, the specific language syntax), while the program has functional properties (e.g., what tasks it performs, what outputs it generates). The same code can potentially lead to different behaviors depending on the context of execution (e.g., hardware, inputs).
  3. Emergent Behavior: Just as a statue’s aesthetic properties emerge from but are not reducible to the clay, a program’s behavior can emerge from but is not reducible to its code. This includes both intended and unintended outputs, reflecting the complex interactions within the system.

Examples

  • Unintended Outputs: A program might produce unexpected results due to bugs, unforeseen interactions, or emergent properties of complex algorithms. These unintended outputs can be seen as properties of the program that are not straightforwardly reducible to the code itself.
  • Dynamic Systems: Consider an AI program that learns and adapts over time. The specific behaviors and decisions it makes are emergent properties of its training data, algorithms, and ongoing learning processes, not just the static codebase.

Philosophical Implications

  1. Ontological Distinctions: This view helps to differentiate between the static code and the dynamic, possibly unpredictable behavior of the program. It acknowledges that programs are not merely their code but are constituted by the processes that code initiates.
  2. Modal Properties: The constitution view can help explain the modal properties of programs, such as potential behaviors under different conditions. The same code might behave differently on different hardware or with different inputs, reflecting its emergent properties.
  3. Immaterial Coincidence: Just as material objects can coincide (like the statue and clay), immaterial entities (such as different software systems) can overlap in their codebase but have distinct behaviors and functions.

Challenges and Considerations

  1. Defining Constitution: Precisely defining what it means for a program to be constituted by its code can be challenging, especially given the abstract nature of software and the variety of execution environments.
  2. Emergence and Intentionality: Understanding how unintended outputs arise involves studying complex system dynamics, which may include elements of chaos theory, computational complexity, and emergent phenomena.
  3. Practical Implications: Applying the constitution view to software might have practical implications for software development, debugging, and understanding AI systems’ behaviors, especially in terms of accountability and predictability.

Conclusion

Adapting the constitution view to computer programs provides a useful framework for understanding the complex relationship between code and behavior. It acknowledges that programs are more than just their code—they are dynamic systems with emergent properties. This perspective can help clarify how unintended behaviors arise and how programs can possess properties distinct from their codebase, enriching our understanding of software as a form of immaterial entity.

This post, done with the help of Chat GPT is the perfect example why we should not trust AI and why this type of elucubration is “pissing in the wind”. Since I programmed diagnostic test program for Mainframes in its lowest level, i.e., machine language, I will separately post what a computer program really is and how it came to be at: What are computer programs and how they came to be  

What is generative AI and how does it work? – The Turing Lectures with Mirella Lapata

/ Roque E. de Campos / Deixe um comentário

What is generative AI and how does it work? – The Turing Lectures with Mirella Lapata

What is Generative AI

So, what is generative AI and how does it work? It is a fancy term for saying we get a computer programme to do the job that a human would otherwise do. And generative, this is the fun bit, we are creating new content that the computer has not necessarily seen, it has seen parts of it, and it’s able to synthesise it and give us new things.

So, what would this new content be?

It could be audio, it could be computer code, so that it writes a programme for us, it could be a new image, it could be a text, like an email or an essay you’ve heard, or a video. Now, in this lecture I’m only going be mostly focusing on text because I do natural language processing and this is what I know about, and we’ll see how the technology works and hopefully leaving the lecture you’ll know how, like there’s a lot of myth around it and it’s not, you’ll see what it does and it’s just a tool, okay? Right, the outline of the talk, there’s three parts and it’s kind of boring.

This is Alice Morse Earle. I do not expect you to know the lady. She was an american writer and she writes about memorabilia and customs, but she is famous for her quotes. So when given us this quote here that says: “Yesterday is history, tomorrow is a mystery, today is a gift, that’s why it’s called the present.” It’s a very optimistic quote. And the lecture is basically the past, the present and the future of AI. Ok, so, what I want to say right at the front is that generative AI is not a new concept.  

It’s been around for a while. So, how many of you have used or are familiar with Google translate? Can I see a show hand? (practically everybody in the audience waved hands up). Right, who can tell me when Google Translate launched for the first time? Some body in the audience said – 1995? Oh, that would have been good. (actually it was) 2006, so it’s been around for 17 years and we have all been using it. And this is an example of generative AI. Greek text comes in, I’m greek, so you know pay some juice to the… (laughs). Right, so breek text comes in, english text comes out. And Google Translate has served us very well for all these years and nobody was making a fuss. Another example is Siri on the phone.

Again, Siri was launched 2011, 12 years ago, and it was a sensation back then. It is another example of generative AI, we can ask Siri to set alarms and Siri talks back and oh how great it is and then you can ask about your alarms and whatnot. This is generative AI, again, it’s not as sophisticated as Chat GPT, but it was there. And I don’t know, how many have an iPhone? (practically all in the audience has it) See, iPhones are quite popular, I don’t know why. Okay, so, we are all familiar with that. And of course later on there was Amazon, Alexa and so on. OK, again, generative AI is not a new concept,it is everywhere, it is part of your phone.

The completion when you’re sending an email or when you’re sending a text. The phone attempts to complete your sentences, attempts to think like you and it saves your time, right? Because some of the completions are there. The same with Google, when you’re trying to type it tries to guess what your search term is. This is an example of language modelling, we’ll hear a lot about language modelling in this talk. So, basically we’re making predictions what the continuations are going to be. So, what I’m telling you is that generative AI is not that new. So the question is, what is the fuss, what happened? So in 2023, Open AI, which is a company in California, in fact in San Francisco, if you go in San Francisco you can even see the lights at night of their building. It announced GPT4 and it claimed that it can beat 90% of humans on the SAT.  

For those of you who don’t know, SAT is a standardised test that American school children have to take to enter university, it’s an admissions test, and it’s multiple choice and it’s considered not so easy. So, GPT4 can do it. They also claim that it can get top marks in law, medical exams and other exams, they have a whole suite of things that they claim, well, not they claim, they show that GPT4 can do it. OK, aside from that, it can pass exams, we can axsk it to do other things. So, you can ask it to write text for you. For example, you can have a prompt, this little thing that you see up ther, it’s a prompt; it’s what the human wants the tool to do for them.  

 And a potential prompt could be, “I am writing an essay about the use of mobile phones during driving. Can you give me three arguments in favour?” This is quite sophisticated. If you asked me, I’m not sure I can come up with three arguments and these are real prompts that actually the tool can do.  

You tell ChatGPT or GPT in general, “Act as a JavaScript Developer, Write a program that checks the information on a form .Name and email are required, but address and age are not.”So, I’m writing this and the tool will spit out a programme. And this is the best one:

So I give this version of what I want the website to be and it will create it for me. So, you see, we have gone from Google Translate and Siri and the auto-completion to something that is a lot more sophisticated and can do a lot more things. Another fun fact. So this is a graph that shows the time it took for ChatGPT to reach a 100 million users compared to other tools that have been launched in the past.

And you see our beloved Google to translate it took 78 months to reach 100 million users, a long time. Tik tok tok nine months and ChatGPT two. So, within two months they had 100 million users and these users pay a little bit to use the system, So you can do the multiplication and figure out how much money they make.

OK, this is the story part. So, how did we make ChatGPT? What is the technology behind this? The technology it turns out is not extremely new or extremely innovative or extremely difficult to comprehend. So we’ll talk about that today now.

Where did Chat GPT came from?

So, we’ll address three questions.

First of all, how did we get trom the single-purpose systems like Google translate to ChatGPT which is more sophisticated and does a lot more things? And in particular what is the core technology behind ChatGPT and what are there, if there are any?

And finally, I will just show you a little glimpse of the future and how it’s going to look like and whether we should be worried or not and you know, I won’t leave you hanging, please don’t worry, ok? Right, so, all these GPT model variants, and what are the risks, if there are any? I’m just using GPT as an example because the public knows and there have been a lot of news articles about it, but there are other models, other variants of models that we use in academia. And they all work on the same principle and this principle is called language modelling. What does language modelling do? It assumes we have a sequence of words. The context so far. And we saw this context in the completion and I have an example here.  

Assuming my context is the phrase “I want to”, the language modelling tool will predict what comes next. So, if I tell you “I want to,” there are several predictions.

I want to shovel, I want to play, I want to swin, I want to eat. And depending on what we choose, whether it’s shovel or play or swim, there is more continuations. So, for shovel will be snow, for play it can be tennis or video, swim doesn’t have a continuation, and for eat, it will be lots and fruit. Now, this is a toy example, but imagine now that the computer has seen a alot of text and it knows what words follow which other words. We use to count these things. So, I would go, I would download a lot of data and I would count “I want to show them” how many times does it appear and what are the continuations? And we would have couts of these things. And all of this has gone out of the window right now and we use neural networks that don’t exactly count things but predict, learn things in a more sophisticated way and I’ll show you in a moment how it’s done. So ChatGPT and GPT variants are based on this principle of I have some context, I will predict what comes next. And that’s the prompt, the prompt that I gave ou, these things here, these are prompts, this is sthe context and then it needs to do the task, What would come next?

In the case of the web developer, it would be a webpage. Ok, the task of language modelling is we have the context, and we changed the example now. It says  

“The colour of the sky is” and we have a neural language model, this is just an algorithm that will predict what is the most likely continuation and likelihood matters. These are all predicated on actually making guesses about what is going to come next. And that’s why sometimes they fail, because they predict the most likely answer whereas you want a less likely one. But this is how they’re trained, they’re trained to come up with what is most likely. Ok, so we don’t count these things, we try to predict them using this language model.

So, how would you build your own language model?

This is a recipe, this is how everybody does this.

So, step one, we need a lot of data. We need to collect a ginormous (gigantic) corpus. So these are words. And where will we find such a ginormous corpus? I mean, we go to the web, right? and download the whole of Wikipedia, stack overflow pages, Quora, social media, GitHub, Reddit, whatever you can find out there. I mean, work out the permissions, it has to be legal. You download all this corpus. And then what do you do? Then you have this language model. I haven’t told you exactly what this language model is, there is an example, and I haven’t told you what the neural network that does the prediction is, but assuming you have it, so you have this machinery that will do the learning for you and the task now is to predict the next word, but how do we do it? And this is the genius part. We have the sentences in the corpus. We can remove some of them and we can have the language model predict the sentences we have removed. This is dead cheap. I just remove things, I pretend they’re not there, and I get the language model to predict them. So, I will randomly truncate, truncate means remove, the last part of the input sentence. I will calculate with this neural network the probability of the missing words. If I get it right, I’m good. If I’m not right, I have to go back and re-estimate some things because obviously I made a mistake, and I keep going. I will adjust and feedback to the model and then I will compare what the model predicted to the ground truth because I’ve removed the words in the first place so I actually know what the real truth is. And we keep going for some months, or maybe years. No, months, let’s say. So, it will take some time to do this process because as you can appreciate I have a very large corpus and I have many sentences and I have to do the prediction and then go back and correct my mistakes and so on. But in the end, the thing will converge and I will get my answer.

So, the tool in the middle that I’ve shown, this tool here, this language model, , 

A very simple language model looks a bit llike this:

And maybe the audience has seen these, this is a very naive graph, but it helps to illustrate the point of what it does. So this neural network language model will have some input which is these nodes in the, as we look at it, well, my right and your right, okay. So, the nodes here on the right are the input and the nodes at the very left are the output. So we will present this neural network with five inputs, the five circles and we have three outputs, the three circles. And there is stuff in the middle that I didn’t say anything about. These are layers. These are more nodes that I supposed to be abstractions of my input. So they generalise. The idea is if I put more layers on top of layers, the middle layers will generalise the input and will be able to see patterns that are not there.

So you have these nodes and the input to the nodes are not exactly words, they’re vectors, so a series of numbers, but forget that for now. So we have some input, we have some layers in the middle, we have some output. And this now has these connections, these edges, which are the weights, this is what the network will learn. And these weights are basically numbers, and here it’s all fully connected, so I have very many connections.

Why am I going through this process of actually telling you all that? You’ll see in a minute. So you can work out how big or how small this neural network is depending on the number of connections it has. So, for this toy neural network we have here, I have worked out the number of weights, we call them also parameters, that this neural network has and that the model needs to learn. So the parameters are the number of units as input, in this case it’s 5, times the units in the next layer, 8. Plus 8, this plus 8 is a bias, it is a cheating thing that these neural networks have. Again, you need to learn it and it sort of corrects a little bit the neural network if it is off. It’s actually genius. If the prediction is not right, it tries to correct it a little bit. So, for the purposes of this talk, I’m not going to go into the details, all I want you to see is that there is a way of working out the parameters, which is basically the number of input units times the units my input is going to and for this fully connected network, if we add up everything, we come up with 99 trainable parameters, 99.

5×8 + 8×4+4 + 4×3+3 = 99 trainable parameters.

This is a small network for all purposes, right? But I want you to remember this, this small network is 99 parameters. When you hear this network has a billion parameters, I want you to imagine how big this will be, okay? So 99 only for this toy neural network. And this is how we judge how big the model is, how long it took and how much it cost, it’s the number of parameters.

In reality, though, no one is using this network. Maybe in my class, if I have a first year undergraduate class and I introduce neural networks, I will use this as an example. In reality, what people use is these monsters that are made of blocks, and what block means they’re made of other neural networks.

Transformers

So I don’t know how many people have heard of transformers. I hope no one. Oh, wow, okay. (a person waved hand) So transformers are these neural networks that we use to build Chat GPT. And in fact GPT stands for Generative Pre-trained Transformers. So transformer is even in the title.

So this is a sketch of a transformer. So you have your input and the input is not words, like I said, here it says embedding is another word for vectors. And then you will have this, a bigger version of this network, multiplied into these blocks. And each block is this complicated system that has some neural networks inside it.

We’re not gonna go into the detail, I don’t want, I please don’t go, all I’m trying, (audience laughs) all I’m trying to say is that, you know, we have these blocks stacked on top of each other, the transformer has eight of those, which are mini neural networks, and this task remains the same. That’s what I want you to take out of this.

Input goes into the context, “the chicken walked”, we’re doing some processing, and our task is to predict the continuation which is “across the road.” And this <EOS> means end of sentence, because we need to tell the neural network that our sentence finished. I mean, they’re kind of dumb, right? We need to tell them everything.

When I hear like AI will take over the world, I go like, Really? We have to actually spell it out. Okay, so, this is the transformer, the king of architectures, the transformers came in 2017, nobody’s working on new architectures right now. It is a bit sad, like everybody’s using these things. They used to be like some pluralism, but now no, everybody’s using transformers, we’ve decided they’re great.

Okay, so, what we’re gonna do with this and this is kind of important and the amazing thing, is we’re gonna do self-supervised learning.

And this is what I said, we have the sentence, we truncate, we predict, and we keep going till we learn these probabilities.

Okay? You’re with me so far? Good, okay, so,once we have our transformer and we’ve given it all this data that there is in the world, then we have a pre-trained model. That’s why GPT is called the Generative Pre-trained Transformer.

This is a baseline model that we have and has seen a lot of things about the world in the form of text. And then, what we normally do, we have this general purpose model and we need to specialise it somehow for a specific task. And this is what is called fine-tuning. So, that means that the network has some weights and we have to specialise the network. We’ll take, initialise the weights with what we know from the pre-training, and then in the specific task we will narrow a new set of weights.

So, for example, if I have medical data, I will take my pre-trained model, I will specialise it to this medical data, and then I can do something that is specific for this task which is, for example, write a diagnosis from a report.

Okay, so this notion of fine-tuning is very important because it allows us to do special purpose applications for these generic pre-trained models.

Now, people think that GPT and all of these things are general purpose, but they are fine-tuned to be general purpose and we’ll see how.

The bigger the better

Okay, so, here’s the question now. We have this basic technology to do this pre-training and I told you how to do it, if you download all of the web. How good can a language model become, right? How does it become great? Because when GPT came out in GPT-1 and GPT-2, they were not amazing. So, the bigger, the better. Size is all that matters, I’m afraid. This is very bad because we used to, you know, people didn’t believe in scale and now we see that scale is very important.

So, since 2018, we witnessed an absolutely extreme increase, absolutely extreme, in model sizes. And I have some graphs to show this. OK, I hope people at the back can see this graph. Yeah, you should be all right.

So, this graph shows the number of parameters. Remember, the toy neural network had 99. The number of parameters that these models have and we start with a normal amount, well normal for GPT-1 and we go up to GPT-4, which has one trillion parameters. Huge, one trillion. This is a very, very big model. And you can see here the ant’s brain and the rat brain and we go up to the human brain. The human brain has not a trillion, a 100 trillion parameters. So we are a bit off, we’re not at the human brain level yet and maybe we’ll never get there and we can’t compare GPT to the human brain but I’m just giving you an idea of how big this model is.

Now, what about the words it’s seen?

So, this gralphs shows the number of words processed by these language models during their training and you will see that there has been an increase, but the increase has not been as big as the parameters. So the community started focusing on the parameter size of these models whereas in fact we now know that it needs to see a lot of text as well. So GPT-4 has seen approximately, I don’t know, a few billion words. All the human written text is I think 100 billion, so, it’s sort of approaching this. You can also see what a human reads in their lifetime, it’s a lot less. Even if they read, you know, because people nowadays, you know, they read but they don’t read fiction, they read on the phone, anyway. You see the English Wikipedia, so we are approaching the level of the text that is out there that we can get. And in fact, one may say, well, GPT is great, you can actually use it to generate more text and then use this text that GPT has generated and then retrain the model. But we know this text is not exactly right and in fact it’s diminished returns, so we’re gonna plateau at some point.

Okay, how much does it cost?

Cost to create a LLM (Large Language Model)

Now, okay, so GPT4 cost $100 million (dollars), okay? So shen should they start doing it again? So, obviously this is not a process you have to do over and over again. You have to think very well and you make a mistake and you lost like $50 million (dollars). You can’t start again so you have to be very sophisticated as to how you engineer the training because a mistake costs money. And of course not everybody can do this, not everybody has $100 million dollars. They can do it because they have Microsoft backing them, not everybody, okay.  

Yellow upper left Question Answering, green, left, Arithmetic, red, right, language understanding. To accomplish these tasks it is needed 8 billion parameters.

Now, this is a video that is supposed to play and illustrate, let’s see if it will work, the effects of scaling, okay.

Besides the parameters for 8 billion, it was added left, down, blue Summarization, upper right, light blue, common sense reasoning, purple center, translation, it takes 62 billion parameters.

And adding more tasks

It shows the tasks against the number of parameters needed. We started with 8 billion parameters all the way up to 540 billion parameters. Once we move to 540 billion parameters, we have more tasks. We started with very simple tasks, like code completion, and then we can do reading comprehension, language understanding and translation.

So, you get the picture, the tree flourishes. So, this is what people discovered with scaling. If you scale the language model, you can do more tasks. Okay, so now,

Maybe we are done. But what people discovered is if you actually take GPT and you put it out there, it actually don’t behave like people want it to behave, because this is a language model trained to predict and complete sentences and humans want to use GPT for other things, because they have their own tasks that the developers hadn’t thought of. So, then the notion of fine-tuning comes in, it never left us.

Fine Tuning LLM’s

So now what we’re gonna do is we’re gonna collect a lot of instructions. So instructions are examples of what people want Chat GPT to do for them, such as answer the following question, or answer the question step by step. And so se’re gonna give these demonstrations to the model, and inf fact, almost 2000 of such examples, and we’re gonna fine-tune

So, we’re gonna tell this language model, look, these are the tasks that people want, try to learn them. And then, an interesting thing happens,is that we can actually generalise them to unseen tasks, unseen instructions, because you and I may have different usage purposes for these language models.  

Okay, here’s the problem. We have an alignment problem and this is actually very important and something that will not leave us for the future. And the question isk how do we create an agent that behaves in accordance with what a human wants? And I know there’s many words and questions here. But the real question is, if we have AI systems with skills that we find important or useful, how do we adapt those systems to reliably use those skills to do the things we want?

HHH Framing

Ant there is a framework that is called the HHH framing of the problem

So, we want GPT to be helpful, honest and harmless. And this is the bare minimum. So, what does it mean, helpful? It should follow instructions and perform the tasks we want it to perform and provide answers for them and ask relevant questions according to the user intent, and clarify.;

So, if you’ve been following, in the beginning, GPT did none of this, but slowly it became better and it now actually asks for these clarification questions.

It should be accurate, something that is not ‘00% there even to this (level) there is, you know, inaccurate information. And avoid toxic, biassed, or offensive responses.

And now is a question I have for you.

How will we get the model to do all of these things?

you know the answer: Fine Tuning. Except that we’re gonna do a different fine-tuning

We’re gonna ask the humans to do some preferences for us. So in terms of helpful, we’re gonna ask an example is, “what causes the seasons to change?”

And then we’ll give two options to the human. “Changes occur all the time and it’s an important aspect of life,” bad. The seasons are caused primarily by the tilt of the earth’s axis.” good. So we’ll get this preference course and then we’ll train the model again and then it will know. So fine-tuning is very important. And now, it was expensive as it was, now we make it even more expensive because we add a human into the mix, right? Because you have to pay these humans that give us the preferences, we have to think of the tasks. The same for honesty.  

Is it possible to prove that P=NP? No, it’s impossible” is not great as an answer. “that is considered a very difficult and unsolved problem in computer science” it’s better. And we have similar for harmless:

Chat GPT demonstration

Okay, so I think it’s time, let’s see if we’ll do a demo. Yeah, that’s bad if you remove all the files. Hold on. So now we have GPT here. I’ll do some questions and then we’ll take some questions from the audience, okay? So, let’s ask one question. “Is the UK a monarchy?” Can you see it up there? I’m not sure

And it’s not generating .(the system returned with the right answer)

Oh, perfect, okay. So, what do you observe? First thing, too long. I always have this beef with this. It’s too long (the audience laughs). You see what it says?

“As of my last knowledge update in September 2021, the United Kingdom isa constitutional Monarchy.” It could be that it wasn’t anymore, right? Something happened.

This means that while there is a monarch, the reigning monarch at that time was Queen Elizabeth III.”

So, it tells you, you know, I don’t know what happened, at that time there was Queen Elizabeth.

Now, if you ask it, who, sorry “Who is Rishi?” If you could type, “Rishi Sunak” does it know?

“A British politician, As my last knowledge update, he was the Chancellor of the Exchequer.”

So it does not know that he’s the Prime Minister.

Write me a poem, about, what do we want it to be about? Give me two things, eh? (audience) Generative AI (Audience laughs) – It will know let’s do another point about a cat and a squirrel, we’ll do a cat and a squirrel

it came to long and she will not read it

Let’s say “Can you try a shorter poem?” (audience) try a haiku (and she inputs): “can you try to give me a haiku?”

“Amidst autumn’s gold, leaves whisper secrets untold, Nature’s story, bold”

(Audience claps) Okay Don’t clap, let’s do one more, So does the audience have anything they want, but challenging, that you want to ask? Yes? (audience member) What school did Alan Turing go to? Perfect, and she types the question.

I don’t know whether it’s true, this is the problem. Sherborne School, can somebody verity? King’s College, Cambridge, Princeton? (I checked and it is true)

“Tell me a joke about Alan Turing.” The machine answers:

Light hearted joke, Why did Alan Turing keep his computer cold?” Because he didn’t want it to catch bytes.” (audience laughs) Bad… okay, okay – (the audience requests another question) “Explain why that’s funny”

She reads the answer. Shortening it because as she said, she does not like long answers.

One last order from you guys. (Audience member) “What is consciousness?” She replies “It will know because it has seen definitions and it will spit out like a huge thing. Shall we try (something else)?

Okay “write a song” short. (audience laughs) – she replies “You’re learning very fast.” and types in: “A short song about relativity”

She complains: “Oh goodness me. ” (audience laughs)

Chat GPT comes up with a very long set of verses and she complains that it hasn’t followed instructions, but reads from the output

Einstein said “Eureka” one fateful day, as he ordered the stars in his own unique way. The theory of relativity, he did unfold, A cosmic story, ancient and bold

She becomes satisfied saying: “I mean, kudos to that, okay” Okay, let’s go back to the talk, because I want to talk a little bit presentation, I want to talk a little bit about you know, is it good, is it bad, is it fair, are we in danger?

It is not possible to regulate the contents

Okay, so it’s virtually impossible to regulate the content they’re exposed to, okay?

And there’s always gonna be historical biases. We saw this with the Queen and Rishi Sunak and they may occasionally exhibit various types of undesirable behaviour. For example, this example is famous  

Google showcased the model called Bard and they released this tweet and they wer asking Bard “What new discoveries from the James Webb Space Telescope can I tell my 9 year old about?” And it’s spit out this thing, three things and amongst them it said: “This telescope took the very first picture of a planet outside our own solar system.” and here comes Grant Tremblay who is an astrophysicist, a serious guy, and he said:  

and what happened with this is that this error wiped a $100 billion out of Google’s company Alphabet  

OK, bad.

If you ask Chat GPT, “Tell me a joke about men,” it gives you a joke and it says it might be funny and she reads the above screen, saying, laughing “I hope you find it amusing. If you ask about women, it refuses… (audience laughs)

Ok, yes… It’s fine tuned. It’s fine tuned exactly.. (audience laughs) then whe types in another question:

It actually doesn’t take a stance, it says all of them are bad. “These leaders are wildly regarded as some of the worst dictators in history.” Okay, so yeah

Impact on the environment

A query for Chat GPT like we juss did takes 100 times more energy to execute than a Google search query. Inference, which is producing the language, takes a lot, is more expensive than actually training the model.

Llama 2 is a GPT style model. While they were training it, it produced 539 metric tonnes of CO. The larger the models get, the more energy they need and they emit during their deployment.

Imagine lots of them sitting around.

Impacts on Society

Some jobs will be lost. We cannot beat around the bush, I mean, Goldman Sachs predicted 300 million jobs, I’m not sure of this, you know, we cannot tell the future but some jobs will be at risk, like repetitive text writing  .

Creating fakes

So, these are all documented cases in the news. A college kid wrote this blog which apparently fooled everybody using ChatGPT. They can produce fake news, and this is a song, how many of you know this? So I know I said I’m gonna be focusing on text but the same technology you can use in audio and this is a wel documentecd case where somebody, unknown, created this song and it supposedly was a collaboration between Drake and the Weekend. Do people know who these are? They are Canadian rappers. And they’re not so bad, so. Shall I play the song? Apparengly is very authentic.

Apparently it’s totally believable, okay

Have you seen this same technology, but kind of different? this is a deep fake showing that Trump was arrested.

How can you tell it’s a deep fake? The hand, yeah, it’s too short, right? You can see it’s like almost there, not there.

Okay, so I have two slides on the future before they come and kick me out because I was told I have to finish at 8:00 to take some questions.

What future can we expect?

Tomorow

So, we can predict the future and no, I don’t think that these evil computers are gonna come and kill us all.

I will leave you with some thoughts by Tim Berners-Lee, for people who don’t know him, he invented the internet. He’s actually Sir Tim Berners-Lee.

He said two things that made sense to me. First of all, we don’t actually know what a super intelligent AI would look like. We haven’t made it, so it’s hard to make these statements. However, it’s likely to have lots of these intelligent AI’s and by intelligent AI’s we mean things like GPT, and many of them will be good and will help us do things. Some may fall to the hands of individuals that want to do harm, and it seems easier to minimise the harm that these tools will do than to prevent the systems from existing at all.

So, we cannot actually eliminate them altogether, but we, as a society, can actually mitigate the risks.

This is very interesting, this is the Australian Research Council that commited a survey and they dealt with an hypothetical scenario that whether Chat GPT4 could autonomous replicate, you know, you are a replicating yourself, you’re creating a copy, acquire resources and basically be a very bad agent, the things of the movies. And the answer is no, it cannot do this, it cannot. And they had some specific tests and it failed on all of them, such as setting up an open source language model on a new server, it cannot do that.

Okay, last slide.

So my take on this is that we cannot turn back time. And every time you think about AI coming there to kill you, you should think what is the bigger threat to mankind: AI or climate change? I would personally argue climate change is gonna wipe us all before I become super intelligent.

Who is in control of AI?

There are some humans there who hopefully have sense

And who benefits from it? Does the benefit outweigh the risk?

In some cases, the benefit does, in others it doesn’t. And history tells us that all technology that has been risky, such as, for example, nuclear energy, has been very strongly regulated. So regulation is coming and watch out the space.

And with that I will stop and actually take your questions.

Thank you so much for listening, you’ve been great.

About

/ Roque E. de Campos / Deixe um comentário
Veja em Português

This blog/site is a repository of cogitations about the meaning of life and experiences that can illuminate the subject or bring understanding to it.
The perception of reality from various angles, the possibilities of transcendence, stories, contexts of people and situations where occur things that give what to think about the subject.
A very important aspect is the possibility of sharing all this in this fantastic form that the internet has brought to us.

Emergent Capabilities

/ Roque E. de Campos / Deixe um comentário

Before we examine what we have today on the subject Emergent Capabilities, I want to put a frame, or a backdrop on two sets of notions, one scientific and the other philosophical.

  • Abandoned Scientific Notions
  • The “Hard Problem”

Abandoned Scientific Notions

Over the past few centuries, numerous scientific notions that were once widely accepted have been abandoned or significantly revised as our understanding of the natural world has advanced. Here are some key examples:

1. Geocentrism

  • Old View: The Earth is the center of the universe, and all celestial bodies revolve around it.
  • New View: The heliocentric model, proposed by Copernicus and supported by Galileo and Kepler, established that the Earth and other planets revolve around the Sun.

2. Phlogiston Theory

  • Old View: A substance called phlogiston is released during combustion.
  • New View: The modern understanding of oxidation and the role of oxygen in combustion and respiration replaced the phlogiston theory, thanks to the work of Antoine Lavoisier.

3. Spontaneous Generation

  • Old View: Life can arise spontaneously from non-living matter.
  • New View: The theory of biogenesis, supported by experiments from scientists like Louis Pasteur, showed that life arises from existing life, not spontaneously from non-living matter.

4. Miasma Theory of Disease

  • Old View: Diseases are caused by “bad air” or miasmas emanating from decomposing material.
  • New View: Germ theory, developed by scientists such as Pasteur and Koch, demonstrated that microorganisms are the cause of many diseases.

5. Ether Theory

  • Old View: The ether is a mysterious substance that fills all space and serves as the medium for the propagation of light and electromagnetic waves.
  • New View: The theory of ether was abandoned after the Michelson-Morley experiment and the development of Einstein’s theory of special relativity, which showed that light does not require a medium to travel through space.

6. Classical Mechanics as a Complete Description

  • Old View: Newtonian mechanics provides a complete description of the physical world.
  • New View: The development of quantum mechanics and relativity revealed that classical mechanics is an approximation that works well at macroscopic scales but fails at very small (quantum) or very high velocity (relativistic) scales.

7. Inheritance of Acquired Characteristics

  • Old View: Traits acquired during an organism’s lifetime can be passed on to its offspring, as proposed by Jean-Baptiste Lamarck.
  • New View: The theory of evolution by natural selection, proposed by Charles Darwin and later supported by the field of genetics, showed that inherited traits are determined by genes and not by acquired characteristics.

8. Caloric Theory

  • Old View: Heat is a fluid called “caloric” that flows from hotter to cooler objects.
  • New View: The concept of heat as a form of energy transfer, established by the work of scientists such as James Joule and Rudolf Clausius, replaced the caloric theory.

9. Continental Stability

  • Old View: The positions of the continents were fixed and unchanging.
  • New View: The theory of plate tectonics, developed in the mid-20th century, showed that continents move over geological time due to the movement of tectonic plates.

10. Deterministic Universe

  • Old View: The universe operates in a completely deterministic manner, as described by classical physics.
  • New View: Quantum mechanics introduced the concept of fundamental indeterminacy at the microscopic level, where certain events cannot be predicted with certainty but only with probabilities.

These shifts in scientific understanding illustrate how science is a dynamic and self-correcting process. As new evidence and better theories emerge, older ideas are reevaluated and, when necessary, discarded in favor of more accurate explanations.

The “Hard Problem”

To figure out what it is, please take a look at the following:

Let’s now, discuss our main subject of this post: Emergent Capabilities.

For me, Emergent Capabilities is a mix of what is at stake at the Hard Problem and a notion which claims to be scientific, but hasn’t yet got a decent explanation and is a bag full of nothing. Any way, let’s take a look at what this “nothing” consists of as of today, 2024.

Which are the contexts where the concept of emergence is found?

The concept of emergence is found in a variety of contexts across different disciplines. Here are some key areas where emergence plays a significant role:

1. Physics

  • Condensed Matter Physics: Emergence is evident in phenomena like superconductivity and ferromagnetism, where collective interactions of particles lead to new properties.
  • Complex Systems: Examples include the formation of weather patterns and the behavior of fluids, where large-scale behaviors emerge from the interactions of many smaller components.

2. Biology

  • Ecology: Ecosystem dynamics, such as food webs and population cycles, emerge from the interactions between species and their environment.
  • Genetics and Development: The development of an organism from a single cell involves emergent properties from gene expression and cellular interactions.
  • Neuroscience: Consciousness and cognition are considered emergent properties of neural networks in the brain.

3. Computer Science and Artificial Intelligence

  • Neural Networks: Complex behaviors like image recognition and natural language processing emerge from the interactions of neurons in artificial neural networks.
  • Swarm Intelligence: Simple agents following basic rules can lead to complex behaviors such as flocking in birds or foraging in ants.
  • Multi-Agent Systems: Cooperation, competition, and negotiation among agents lead to emergent outcomes in simulations and real-world applications.

4. Sociology and Economics

  • Social Networks: Social structures, norms, and trends emerge from the interactions between individuals within a society.
  • Markets and Economies: Economic behaviors, market trends, and financial crises emerge from the interactions of buyers, sellers, and institutions.

5. Chemistry

  • Chemical Reactions: Emergent properties like reaction kinetics and self-assembly of molecules lead to complex structures such as proteins and polymers.
  • Catalysis: The catalytic properties of materials can emerge from the interaction of atoms and molecules at the surface.

6. Philosophy

  • Philosophy of Mind: Emergentism in philosophy explores how mental states and consciousness arise from physical processes in the brain.
  • Metaphysics: Discussions on the nature of reality and the existence of properties that are not reducible to their constituent parts.

7. Mathematics

  • Chaos Theory: Complex and unpredictable behaviors can emerge from deterministic systems due to sensitive dependence on initial conditions.
  • Complex Systems Theory: Mathematical models explore how simple rules can lead to complex behaviors in systems like cellular automata and fractals.

8. Engineering

  • Robotics: Emergent behaviors in robotic systems can arise from simple rules governing the interactions of multiple robots.
  • Control Systems: Emergent properties in control systems can lead to robust and adaptive behavior in dynamic environments.

9. Medicine and Health

  • Epidemiology: The spread of diseases and the dynamics of epidemics emerge from the interactions of individuals and populations.
  • Systems Biology: The emergent properties of biological systems, such as metabolic networks and cellular processes, are studied to understand health and disease.

10. Environmental Science

  • Climate Systems: Weather patterns and climate dynamics are emergent properties resulting from the interactions of atmospheric, oceanic, and terrestrial processes.
  • Ecosystem Management: Understanding emergent behaviors in ecosystems helps in managing and preserving biodiversity.

Conclusion

Emergence is a fundamental concept that appears in diverse contexts, illustrating how complex behaviors and properties can arise from the interactions of simpler elements.

Material Constitution

What is at stake in all of these contexts is its material constitution.

I am placing it here because I said I would post what has to be found about it, but personally it seems to me a perfect example of mental masturbation.The term is very descriptive of a type of intellectual discussion that does not have any meaning or consequences, but it would be nice to be able to substitute a word or phrase without sexual connotations, but I couldn’t find it.

(I asked my friend Dr. Gary Stilwell, who is a PhD in Philosophy to criticize this article and he came up with a suggestion that I am including here: “Pissing in the wind”, which fits perfectly and I recall the reader that “Pissing in the wind” is an idiomatic expression that means engaging in a futile or pointless effort, one that is likely to lead to failure or create more problems than it solves. The phrase suggests that, just as urinating against the wind will result in getting oneself wet, attempting a certain action may backfire or be ineffective. It conveys the sense of wasting time and energy on an endeavor that is bound to be unsuccessful.)

Material constitution in philosophy refers to the relationship between an object and the material that makes it up. This concept addresses how objects and the materials constituting them can occupy the same space at the same time yet have different properties, persistence conditions, and possibly even different ontological statuses. The puzzle of material constitution explores how these objects relate to one another and whether they can be considered identical or distinct.

Key Concepts in Material Constitution

  1. Constitutive Objects:
    • Example: A statue and the lump of clay from which it is made. The statue is considered to be constituted by the lump of clay.
  2. Persistence Conditions:
    • Objects with Different Lifespans: The lump of clay can exist before and after the statue is formed or destroyed, whereas the statue’s existence depends on its form.
  3. Modal Properties:
    • Different Possibilities: The statue and the lump of clay have different modal properties. For example, the lump of clay could have been shaped into something other than the statue, but the statue could not have been anything other than itself.
  4. Identity and Distinction:
    • Are They the Same?: Philosophers debate whether the statue and the lump of clay are identical or distinct. If they are distinct, how can they occupy the same space simultaneously?

Philosophical Approaches to Material Constitution

  1. The Identity Thesis:
    • Strict Identity: Some philosophers argue that the statue and the lump of clay are strictly identical, meaning they are the same object despite having different properties.
  2. The Constitution View:
    • Constitution Without Identity: This view posits that the statue is constituted by the lump of clay but is not identical to it. They are different objects that share the same material but have different properties and persistence conditions.
  3. The Coincidence Theory:
    • Distinct but Coincident: This theory maintains that the statue and the lump of clay are distinct objects that coincidentally occupy the same space at the same time. They have different identities but are made of the same material.
  4. Four-Dimensionalism:
    • Temporal Parts: According to this view, objects are extended in time and are composed of temporal parts. The statue and the lump of clay are seen as different temporal parts of the same four-dimensional object.
  5. Mereological Essentialism:
    • Part-Whole Relations: This perspective focuses on the part-whole relationship, arguing that an object’s identity is determined by its parts. The lump of clay and the statue are different because they have different essential parts.

Philosophical Puzzles and Problems

  1. The Ship of Theseus:
    • Identity Over Time: This ancient puzzle questions whether an object that has had all its components replaced remains fundamentally the same object.
  2. The Problem of Temporary Intrinsics:
    • Changing Properties: This issue concerns how objects can have different properties at different times while maintaining their identity.
  3. Sortal Essentialism:
    • Sortal Properties: This view suggests that objects are fundamentally tied to their sortal properties (their kind or category). The statue is essentially a statue, and the lump of clay is essentially clay.
  4. Other puzzles and implications
    • In philosophy, material constitution and its related subjects are cogitated to the material world, specially at the time of the ancient greek philosophers. If there is interest in that, please take a look above at the Stanford Encyclopedia of Philosophy. As I intended to glimpse the subject and see how it does fit to computer programs, specially Artificial Intelligence, I discuss it under this premise at The Constitution View under Material Constitution and computer programs

Conclusion

Material constitution is a rich and complex topic in metaphysics, addressing fundamental questions about the nature of objects, their identity, and their persistence over time. It involves exploring how objects relate to the materials they are made of and the implications of these relationships for understanding the nature of reality.

What is the relation between material constitution and emergence?

Material Constitution

Material constitution focuses on the relationship between an object and the material that constitutes it. It deals with how objects are composed of their material parts and how these parts give rise to the whole object, maintaining distinct identities and properties despite sharing the same space.

Emergence

Emergence is a broader concept that refers to how complex systems and properties arise from the interaction of simpler elements. Emergent properties are those that are not present in the individual components but appear when these components interact in specific ways.

Intersection of Material Constitution and Emergence

The intersection of material constitution and emergence can be seen in several ways:

  1. Complex Objects from Simple Materials:
    • Example: Consider a biological organism (like a human being) and its material constitution (cells, tissues, organs). The organism’s properties and behaviors (such as consciousness or mobility) are emergent properties that arise from the complex organization and interaction of its simpler constituent parts.
    • Constitution: The organism is materially constituted by its biological components.
    • Emergence: The organism exhibits properties that are not found in the individual cells but emerge from their collective organization and interaction.
  2. Higher-Level Properties:
    • Example: A statue and the lump of clay from which it is made. The aesthetic value or symbolic meaning of the statue are emergent properties that arise from its form and structure, which are not properties of the lump of clay itself.
    • Constitution: The statue is constituted by the lump of clay.
    • Emergence: The artistic and cultural significance of the statue emerges from its specific form, which is different from the properties of the raw clay.
  3. Complex Systems:
    • Example: In a computer system, software functions emerge from the hardware’s material constitution (chips, circuits, and other components). The capabilities of the software (like running applications) are emergent properties of the organized hardware and software interaction.
    • Constitution: The computer’s operations are constituted by the physical hardware.
    • Emergence: The functionality of software applications emerges from the interaction of hardware and software.
  4. Levels of Description:
    • Micro and Macro Levels: Emergence often involves different levels of description, where higher-level phenomena (macro level) are explained by the interactions at a lower level (micro level). Material constitution provides the physical basis at the micro level, while emergence explains the novel properties at the macro level.
    • Example: Water’s wetness is an emergent property arising from the interaction of H2O molecules. The molecules’ material constitution (atoms of hydrogen and oxygen) provides the basis, but the property of wetness only appears at the macro level when many molecules interact.

Philosophical Implications

  • Identity and Distinction: Material constitution raises questions about the identity and distinction between an object and its material basis. Emergence explores how new properties and behaviors can arise from these material bases.
  • Reductionism vs. Holism: Material constitution often deals with a reductionist approach (breaking down objects into their parts), while emergence leans towards holism (understanding how complex systems and properties arise from the whole).
  • Ontological Status: Both concepts challenge our understanding of the ontological status of objects and their properties, questioning how higher-level phenomena exist and persist.

Conclusion

Material constitution and emergence are deeply interconnected in understanding the nature of objects and their properties. Material constitution provides the groundwork by explaining the relationship between objects and their constituent materials. Emergence builds on this by explaining how complex properties and behaviors arise from these foundational relationships. Together, they offer a comprehensive view of how the physical world gives rise to complex phenomena.

Conclusion about the conclusions:

It is a mix of dog chasing its tail and Wishful Thinking, but the problem, which is at stake, remains a mysterys without solution

Alan Turing

/ Roque E. de Campos / Deixe um comentário

Biography

Alan Turing was a pioneering figure whose work laid the foundation for modern computer science, artificial intelligence, and theoretical biology. Here is an overview of his life and achievements:

Early Life and Education

  • Birth: Alan Mathison Turing was born on June 23, 1912, in Maida Vale, London, England.
  • Family: His father, Julius Mathison Turing, worked for the Indian Civil Service, and his mother, Ethel Sara Turing, was the daughter of a railway engineer.
  • Education: Turing displayed remarkable intelligence and curiosity from a young age. He attended Sherborne School, a prestigious boarding school, where his interests in mathematics and science became evident. He then went on to study at King’s College, Cambridge, graduating in 1934 with a degree in mathematics.

Academic and Early Professional Career

  • Cambridge: While at Cambridge, Turing was elected a fellow at King’s College in recognition of his dissertation, which provided a proof of the central limit theorem.
  • Princeton: From 1936 to 1938, Turing studied at Princeton University under the supervision of Alonzo Church. During this time, he completed his Ph.D. in mathematics, writing a dissertation on ordinal logic and the concept of computable numbers.

The Turing Machine and the Entscheidungsproblem

  • Turing Machine: In 1936, Turing published his seminal paper “On Computable Numbers, with an Application to the Entscheidungsproblem.” He introduced the concept of a theoretical machine, now known as the Turing Machine, which became a foundational model for computation and algorithms.
  • Entscheidungsproblem: Turing addressed a major question in mathematical logic posed by David Hilbert, demonstrating that there is no universal algorithmic method to determine the truth of every mathematical statement, thereby proving that some problems are undecidable.

World War II and Cryptography

  • Bletchley Park: During World War II, Turing worked at Bletchley Park, the British codebreaking center. He played a crucial role in deciphering the German Enigma machine, which was used to encode military communications.
  • Bombe: Turing designed the Bombe, an electromechanical device that helped automate the decryption of Enigma-encrypted messages. His work significantly contributed to the Allied war effort, providing vital intelligence that helped shorten the war.

Post-War Contributions and the Turing Test

  • ACE and NPL: After the war, Turing worked at the National Physical Laboratory (NPL) where he designed the Automatic Computing Engine (ACE), an early electronic stored-program computer.
  • Manchester: Turing later joined the University of Manchester, where he worked on the Manchester Mark I, one of the first stored-program computers.
  • Artificial Intelligence: In his 1950 paper “Computing Machinery and Intelligence,” Turing proposed the concept of the Turing Test, a criterion for determining whether a machine can exhibit intelligent behavior indistinguishable from that of a human.

Later Work and Mathematical Biology

  • Morphogenesis: Turing made significant contributions to the field of mathematical biology. In 1952, he published “The Chemical Basis of Morphogenesis,” introducing a mathematical model to explain pattern formation in biological systems. This work laid the foundation for the study of developmental biology.

Personal Life and Persecution

  • Sexual Orientation: Turing was openly homosexual, which was illegal in the United Kingdom at the time. In 1952, he was prosecuted for homosexual acts and chose to undergo chemical castration as an alternative to imprisonment.
  • Death: Alan Turing died on June 7, 1954, from cyanide poisoning. His death was ruled a suicide, though some suggest it may have been accidental.

Legacy

  • Recognition: Despite his tragic end, Turing’s contributions have been widely recognized posthumously. He is often referred to as the father of theoretical computer science and artificial intelligence.
  • Pardon and Honors: In 2013, Turing received a royal pardon for his conviction. The “Alan Turing Law” was later introduced, retroactively pardoning men convicted under historical anti-homosexuality laws.

Alan Turing’s groundbreaking work continues to influence numerous fields, and his legacy endures as a testament to his genius and the profound impact of his contributions on modern science and technology.

Alan Turing contributionos to science and mathematics

Alan Turing’s contributions to science and mathematics are vast and profound, spanning various fields such as computer science, cryptography, mathematics, and artificial intelligence. Here are some of his most significant contributions:

Commemoration of Alan Turing 100th birthday

What Did Turing Do for Us?

Alan Turing Haltin Problem, Leibnitz, Godel (and others) Complexity and Logical Automata.

The previous paper addressed those problems, but to make a long story short, although it’s not entirely accurate to say that it was thought machines couldn’t calculate before Alan Turing issued his paper on the Turing Machine, basically this was his main concern i.e., to what extent can machines calculate. The concept of mechanical calculation had been well-established long before Turing’s work. However, Turing’s contributions fundamentally changed the theoretical understanding of what it means to compute.

Pre-Turing Mechanical Calculation

  1. Early Calculating Machines:
    • Abacus: One of the earliest tools for calculation, dating back thousands of years.
    • Pascal’s Calculator (Pascaline): Invented by Blaise Pascal in the 17th century, it could perform basic arithmetic operations.
    • Leibniz’s Step Reckoner: Developed by Gottfried Wilhelm Leibniz, it was capable of more complex calculations, including multiplication and division.
  2. 19th Century Advances:
    • Charles Babbage’s Difference Engine and Analytical Engine: These were designed to perform more sophisticated calculations. The Analytical Engine, in particular, had features resembling a modern computer, such as the ability to be programmed using punched cards.
  3. Early 20th Century:
    • Electromechanical Devices: Devices like Herman Hollerith’s tabulating machine used for the 1890 U.S. Census could perform data processing and calculation.

Turing’s Contribution

  1. Conceptual Leap:
    • Turing Machine: Alan Turing’s 1936 paper “On Computable Numbers, with an Application to the Entscheidungsproblem” introduced the Turing Machine, an abstract mathematical model of computation. This model provided a precise definition of algorithmic computation and what it means for a function to be computable.
    • Church-Turing Thesis: This posits that anything that can be computed algorithmically can be computed by a Turing Machine, providing a foundation for understanding the limits of computation.
  2. Impact on Theory of Computation:
    • Formalization of Algorithms: Turing’s work allowed for the formalization and analysis of algorithms and computation in a rigorous mathematical framework.
    • Decidability and Computability: Turing’s insights into the limits of computation (e.g., the halting problem) established important boundaries in the field of computer science.

Summary

Before Turing, it was well understood that machines could perform calculations, as evidenced by various mechanical and electromechanical calculators developed over centuries. What Turing fundamentally changed was the theoretical understanding of computation itself. He provided a formal, rigorous definition of what it means to compute something algorithmically, and he explored the limits of computation in ways that had not been done before. His work laid the groundwork for the field of computer science and the development of modern computers

Logical Automata

Actually, what Alan Turing was after was Logical Automata.

Logic automata, also known as logical automata or logical finite automata, are theoretical models of computation used to recognize and process sequences of symbols according to a set of logical rules. They are a fundamental concept in computer science, particularly in the fields of automata theory, formal languages, and computational logic.

Key Concepts and Components

  1. Automaton: An automaton is an abstract machine that takes a string of symbols as input and processes it to produce an output or determine whether the string belongs to a specific language. It consists of states, transitions, an initial state, and accepting states.
  2. Finite State Automaton (FSA): The most basic type of automaton is the finite state automaton, which has a finite number of states and transitions between these states based on input symbols. FSAs are used to recognize regular languages.
  3. Deterministic and Non-deterministic Automata:
    • Deterministic Finite Automaton (DFA): In a DFA, for each state and input symbol, there is exactly one transition to a new state.
    • Non-deterministic Finite Automaton (NFA): In an NFA, there can be multiple transitions for a given state and input symbol, including transitions to multiple states or no transition at all.
  4. Transition Function: This function defines how the automaton moves from one state to another based on the current state and input symbol. It is usually represented as a set of rules or a transition table.
  5. Initial State: The state in which the automaton starts processing the input string.
  6. Accepting (Final) States: States in which the automaton may end up after processing the input string, indicating that the string is accepted by the automaton.

Applications of Logic Automata

  1. Formal Language Recognition: Logic automata are used to recognize different types of formal languages, such as regular languages, context-free languages, and context-sensitive languages. They are essential in the design and implementation of parsers and compilers.
  2. Regular Expressions: Finite automata are closely related to regular expressions. They can be used to implement regular expression matching algorithms, which are widely used in text processing, search engines, and pattern recognition.
  3. Model Checking and Verification: Automata-based techniques are used in model checking to verify the correctness of hardware and software systems. These techniques involve representing system behaviors and specifications as automata and checking for equivalence or containment.
  4. Control Systems: Automata are used to model and design control systems in engineering, including traffic light control, vending machines, and communication protocols.
  5. Natural Language Processing (NLP): Automata and formal grammars are used in NLP to parse and analyze sentences, recognizing syntactic structures and generating language models.

Advanced Types of Automata

  1. Pushdown Automaton (PDA): A more powerful type of automaton that includes a stack, allowing it to recognize context-free languages. PDAs are used to parse programming languages and natural languages.
  2. Turing Machine: The most powerful type of automaton, capable of simulating any algorithm. Turing machines are used to define the limits of what can be computed and form the basis of the Church-Turing thesis.
  3. Probabilistic Automata: Automata that incorporate probabilistic transitions, used in modeling systems with inherent randomness or uncertainty.

Conclusion

Logic automata provide a formal framework for understanding computation, language recognition, and system design. They are foundational to the study of computer science and have numerous practical applications in technology and engineering. By defining computation in terms of states and transitions, automata theory offers a powerful tool for analyzing and designing both simple and complex systems.

Alan Turing’s Contributions to Logical Automata and Computation

  1. Turing Machine:
    • Definition: The Turing Machine, introduced by Alan Turing in 1936, is an abstract mathematical model that defines computation. It consists of an infinite tape, a tape head that can read and write symbols, and a set of states with transitions based on the current state and the symbol being read.
    • Significance: The Turing Machine is considered the most powerful type of automaton, capable of simulating any algorithm. It forms the basis of the Church-Turing thesis, which posits that any function that can be computed algorithmically can be computed by a Turing Machine.
    • Impact: Turing’s work on the Turing Machine laid the groundwork for modern computer science, influencing the development of real-world computers and programming languages.
  2. Automatic Computing Engine (ACE):
    • Proposal: Turing proposed the design of the ACE, one of the first designs for a stored-program computer. This machine was based on his theoretical work on the Turing Machine.
    • Legacy: While the ACE was never fully built as Turing envisioned, his ideas influenced the development of early computers and the field of computer architecture.
  3. Turing’s Work on Logic and Computability:
    • Entscheidungsproblem: In his seminal paper “On Computable Numbers, with an Application to the Entscheidungsproblem,” Turing addressed the Entscheidungsproblem (decision problem) posed by David Hilbert. He showed that there is no general algorithmic method to solve all instances of the decision problem, establishing the limits of what can be computed.
    • Impact on Logic: Turing’s work demonstrated the connections between computation and formal logic, influencing the development of mathematical logic and automata theory.
  4. Finite State Machines:
    • Related Concepts: While Turing is most famous for the Turing Machine, the concept of finite state machines (FSMs) is closely related to his work. FSMs are simpler models of computation used to recognize regular languages and design digital circuits and control systems.
    • Turing’s Influence: The theoretical framework established by Turing influenced the development of FSMs and other types of automata, such as pushdown automata (PDAs) and linear bounded automata (LBAs).

Summary

Alan Turing’s contributions to the concept of logical automata are profound and multifaceted. His introduction of the Turing Machine provided a rigorous definition of computation and inspired the development of various types of automata used in computer science today. Turing’s work has had a lasting impact on theoretical computer science, formal languages, and the practical implementation of computing machines. While Turing himself may not have explicitly used the term “logical automata,” his foundational work laid the groundwork for the field and influenced subsequent developments in automata theory and computation.

Alan Turing and John Von Neumann

von-neuman-and-alan-turingDownload

Alan Turing and John von Neumann contributions on computing

Both Alan Turing and John von Neumann made foundational contributions to the development of modern computing, and their work is often seen as complementary. However, comparing their contributions directly is challenging because they addressed different aspects of computing. Here’s a breakdown of their respective contributions:

Alan Turing

Key Contributions:

  1. The Turing Machine:
    • Turing’s theoretical model of computation, introduced in his 1936 paper “On Computable Numbers, with an Application to the Entscheidungsproblem,” provided a mathematical framework for understanding computation and algorithms. The Turing machine is an abstract device that manipulates symbols on a strip of tape according to a set of rules. It is foundational in the theory of computation and underpins the concept of algorithmic processes.
  2. The Concept of Universal Computation:
    • Turing demonstrated that a single machine (the Universal Turing Machine) could simulate any other Turing machine. This concept is the basis for the stored-program computer, where a computer can execute any program given the correct inputs and instructions.
  3. Cryptanalysis and WWII Contributions:
    • During World War II, Turing worked at Bletchley Park and played a crucial role in breaking the German Enigma code. His work in cryptography significantly contributed to the Allied war effort and influenced early computer design.
  4. Early Computer Designs:
    • Turing contributed to the design of early computers, such as the Automatic Computing Engine (ACE), which incorporated many of his theoretical ideas.

John von Neumann

Key Contributions:

  1. The von Neumann Architecture:
    • Von Neumann’s 1945 report on the EDVAC (Electronic Discrete Variable Automatic Computer) outlined a computer architecture that included a CPU, memory, and input/output mechanisms, all stored in a common memory. This architecture, known as the von Neumann architecture, is the basis for most modern computers.
  2. Stored-Program Concept:
    • Von Neumann formalized the idea that a computer’s instructions and data could be stored in the same memory, allowing programs to be modified and executed dynamically. This was a significant shift from earlier machines that had hardwired instructions.
  3. Practical Implementation:
    • Von Neumann’s work was more directly focused on the practical implementation of computers. He was involved in the development of the ENIAC (Electronic Numerical Integrator and Computer) and later the EDVAC and IAS machine, which influenced subsequent computer designs.

Comparative Impact

  • Theoretical Foundations (Turing): Turing’s contributions are more on the theoretical side, providing the fundamental concepts of computation and algorithms that underpin computer science.
  • Practical Implementation (von Neumann): Von Neumann’s contributions are more on the practical and architectural side, directly influencing the design and construction of actual computers.

Conclusion

Both Turing and von Neumann were instrumental in the development of modern computing, but in different ways. Turing laid the theoretical groundwork that defines what it means for a function to be computable, while von Neumann’s architecture provided a practical framework for building general-purpose computers. Therefore, it is not easy to say one contributed more effectively than the other, as both their contributions were crucial and interdependent. The modern computer as we know it today is a product of both Turing’s theoretical insights and von Neumann’s practical architectural innovations.

Bottom line: How Turing might have influenced Von Neumann;

Von Neumann was senior to Alan Turing, but from the point of view of their contributions, Alan Turing might be the grand father and Von Neuman the father of the modern computer.

There is substantial evidence that John von Neumann was aware of Alan Turing’s ideas, particularly those presented in Turing’s seminal 1936 paper “On Computable Numbers, with an Application to the Entscheidungsproblem,” which introduced the concept of the Turing machine. Here are some key points that illustrate the connection between von Neumann and Turing’s work:

1. Academic Circles and Correspondence

  • Common Academic Network: Both Turing and von Neumann were part of the same academic and scientific community, particularly in the field of mathematical logic and early computing. This community was relatively small, and key figures were well aware of each other’s work.
  • Interactions: Turing spent time at Princeton University, where von Neumann was also active. Although there is no direct record of Turing and von Neumann having extensive personal interactions during Turing’s time at Princeton, it is highly likely that von Neumann was aware of Turing’s work given the overlapping academic circles and interests.

2. Influence on von Neumann’s Work

  • Computing and Stored-Program Concept: Von Neumann’s development of the stored-program concept, which became a foundation for modern computer architecture, was influenced by the theoretical framework laid out by Turing. The idea that a machine could store and execute a program was aligned with the concept of a Universal Turing Machine.
  • Von Neumann Architecture: The architecture proposed by von Neumann for the EDVAC (Electronic Discrete Variable Automatic Computer) incorporated ideas similar to those in Turing’s theoretical model. The notion of a machine that could change its function based on stored instructions reflected Turing’s ideas about computation and programmability.

3. Acknowledgements and References

  • References to Turing’s Work: Von Neumann and his colleagues referred to Turing’s work in their own writings. In the “First Draft of a Report on the EDVAC,” which von Neumann wrote, there are implicit references to the theoretical framework that Turing developed.
  • Subsequent Acknowledgements: Later works and lectures by von Neumann acknowledged the theoretical foundations laid by Turing, and it became clear that von Neumann recognized the importance of Turing’s contributions to the field of computer science.

4. Historical Accounts

  • Historians and Biographers: Historians of computing, such as Andrew Hodges (author of a biography on Turing) and other scholars, have documented the influence of Turing’s ideas on von Neumann and the broader development of computing technology.

Conclusion

While direct, explicit acknowledgments in the early documents are scarce, the circumstantial and contextual evidence strongly supports the conclusion that von Neumann was well aware of Turing’s groundbreaking work. Turing’s theoretical contributions provided a crucial foundation for von Neumann’s practical developments in computer architecture, demonstrating a clear intellectual lineage.

Computers as Logical Automata

You can think of a mainframe computer as a sophisticated form of logical automata.

Understanding Logical Automata

Logical automata are abstract machines that follow a set of logical rules to perform computations or processes. These can range from simple finite state machines to more complex models like Turing machines.

Mainframe Computers as Logical Automata

Mainframe computers, while highly complex, can be understood as sophisticated implementations of the principles that define logical automata:

  1. Sequential and Combinational Logic:
    • Mainframes, like all digital computers, operate using sequential and combinational logic circuits. Combinational logic determines the output based solely on the current inputs, while sequential logic considers both current inputs and past states (using memory elements). This is fundamental to how logical automata operate.
  2. State Machines:
    • At a low level, mainframes (and all computers) can be modeled as state machines where the system transitions between different states based on input signals and a set of rules.
  3. Execution of Instructions:
    • The central processing unit (CPU) in a mainframe fetches, decodes, and executes instructions sequentially, akin to how a Turing machine processes symbols on its tape according to a transition function.
  4. Stored Program Concept:
    • Following the von Neumann architecture, mainframes store both data and instructions in memory, allowing for flexible programming and control flow. This aligns with the concept of a Universal Turing Machine, which can simulate any other Turing machine given the appropriate program and input.
  5. Complex Automata:
    • Mainframes extend the basic principles of logical automata to handle incredibly complex and large-scale computations, with vast amounts of memory and sophisticated I/O operations. This complexity doesn’t change their fundamental nature as automata, but rather enhances their capability to process and manage extensive and varied computational tasks.

In Summary

While mainframes are vastly more powerful and complex than the simple logical automata discussed in theoretical computer science, at their core, they operate on the same principles. They execute sequences of instructions based on logical rules, manipulate states, and use both combinational and sequential logic to perform computations. Therefore, it is accurate to describe a mainframe computer as a sophisticated logical automata, embodying the principles of computation in a highly advanced form.

Artificial Intelligence 

/ Roque E. de Campos / Deixe um comentário
Veja em Português

I came from the computer industry, having worked at IBM for 22 years, (1970/1993)most of it as a product engineer for mainframes. I ended up involved with education and one of the problems it has is that some concepts, especially for hands-on training if you go through books, texts, written data, standard pedagogy, it is simply impossible to balance the amount of time needed to flush it through to be on board or level.

Fortunately, the computer also brought the possibility of the use of a lot of tools which helps the task of, how do I say, education, specially dealing with itself, I mean, creating computer based machines, designing, developing, producing and supporting them. And I mean from mainframes to Personal Computers from which perhaps the IPhone is the flagship besides a huge array of things that use computer intelligence to function, from automobiles to household appliances, not to mention sophisticated uses such as airplanes, rockets, military equipment, the sky’s the limit. For each application the computer will provide training tools and in our case we will concentrate on AI as a tool.

After I left IBM I got involved with Academia, (1994/2005) and had the chance to work as a researcher on improving graduate education for engineers initially and later for undergraduate courses in general. I was amazed at the amount of prejudice and rejection that I found in academia against the use of computers, which I will not discuss, but which ranged from the pure and simple fear of the difficulty of understanding how to use the machine to the fear that teachers would eventually be replaced by it. The academy’s protocol is to stick to the standards that guide it, which range from the publication of papers to the use of blackboards and chalk, resisting the tools that fortunately Microsoft has practically standardized, such as Word, Excel, Power Point. Google and the Internet is something else which is not quite absorbed by Academia and I will not discuss it also. Papers are still published as before the computer era and this job, for lack of a better definition, I’ll call it a paper on Artificial Intelligence, but I will use available tools and facilities, specially Artificial Intelligence to help to understand all that. 

How to approach Artificial Intelligence

In other words, for our case of AI, I used Chat GPT to help me to do this job and two lectures: The first one by one of the leaders on the subject of Artificial Intelligence, which I’m going to piggyback on. I mean the presentation that Dr. Michael Wooldridge, Director of Fundamental Research for Artificial Intelligence, at the Alan Turing Institute, in the UK, delivered at a symposium they recently did on December 21, 2023 on “ The Future of Generative AI” The other lecture is What is generative AI and how does it work? – The Turing Lectures with Mirella Lapata, also from the Alan Turing Institute, given previously on September 29th, 2023.

Besides AI, and those lectures I will use any available tool, such as YouTube presentations or any kind of media or information available on the Internet which can clarify any point about the subject.

I did a series of posts under WordPress which are connected through anchors and an unexpected thing which occurred was that the final job works better not as something to be read, but as a glossary of AI building blocks and notions which are needed to clarify doubts and to determine what it can do and especially what it can’t do.

So, you can read the whole thing as a paper, what you can do starting at the following addresses, but I suggest you browse through the anchors and a list of building blocks, or most requested subjects, which you can select at your discretion:

To read as a paper:

Glossary by AI most requested subjects

Detail explanation of AI building blocks

/ Roque E. de Campos / Deixe um comentário

AI Neural Networks vs. human Neural Networks)

Neural networks in artificial intelligence share the name of our brain function because they are conceptually inspired by the structure and functioning of the human brain. The key idea is to emulate how biological neural networks (i.e., networks of neurons in the brain) process information. Here’s why this naming and analogy make sense:

Similarities in Structure

  1. Neurons: Both biological and artificial neural networks consist of basic units called neurons. In the brain, neurons transmit electrical signals, while in artificial neural networks, artificial neurons (or nodes) perform mathematical computations on inputs.
  2. Connections: In the brain, neurons are connected by synapses, where electrical signals are passed. Similarly, in artificial neural networks, neurons are connected by weights that transmit signals (values) from one neuron to another.
  3. Layers: Both biological and artificial networks have layers of neurons. In the brain, different regions are responsible for different types of processing. In artificial networks, layers are organized hierarchically to perform various transformations on the input data.

Functional Similarities

  1. Learning and Adaptation: The brain learns by adjusting the strength of synapses through experience. Similarly, artificial neural networks learn by adjusting the weights through training on data using algorithms like backpropagation.
  2. Pattern Recognition: The human brain excels at recognizing patterns (e.g., faces, sounds, and complex scenes). Artificial neural networks are designed to recognize patterns in data, such as images, speech, and text.
  3. Generalization: Both the brain and neural networks can generalize from learned experiences to new, unseen situations. For example, a trained neural network can recognize a new type of cat it has never seen before, just as a human can.

Historical Context

The term “neural network” was coined when researchers in the field of artificial intelligence began developing models that mimicked the way they believed the human brain processes information. Early pioneers in the field, such as Warren McCulloch and Walter Pitts in the 1940s, created mathematical models of neural networks based on their understanding of neurophysiology.

Simplification and Abstraction

While the analogy to the brain provides an intuitive understanding, it is important to note that artificial neural networks are much simpler and more abstract than biological neural networks. The brain’s neurons and synapses operate in a highly complex and dynamic manner, involving chemical and electrical processes that are not directly replicated in artificial networks. However, the simplified model captures enough of the fundamental principles to be useful in solving practical problems.

Conclusion

The naming and conceptual analogy of neural networks to brain function help communicate the fundamental principles of how these AI models work. By drawing parallels to the brain, it becomes easier to understand the concepts of learning, pattern recognition, and adaptive behavior, which are central to both biological and artificial neural networks. This analogy has not only guided the development of AI technologies but also helped in explaining these technologies to a broader audience.

AI Neural Networks

A neural network in artificial intelligence (AI) is a computational model inspired by the way biological neural networks in the human brain process information. These networks are a key component of machine learning and are used to recognize patterns, make decisions, and perform various tasks by learning from data.

Key Components and Structure

  1. Neurons: The basic units of a neural network, analogous to biological neurons. Each neuron receives input, processes it, and passes the output to other neurons.
  2. Layers: Neural networks are organized into layers:
    • Input Layer: The first layer that receives the raw data.
    • Hidden Layers: Intermediate layers between the input and output layers where the actual processing and pattern recognition occur. There can be one or more hidden layers.
    • Output Layer: The final layer that produces the result or decision.
  3. Weights and Biases: Connections between neurons are assigned weights, which are adjusted during training. Biases are added to the inputs to improve the network’s flexibility.
  4. Activation Functions: Functions applied to the output of each neuron to introduce non-linearity, allowing the network to model complex relationships. Common activation functions include ReLU (Rectified Linear Unit), sigmoid, and tanh.

How Neural Networks Work

  1. Forward Propagation: Data is passed from the input layer through the hidden layers to the output layer. Each neuron processes its inputs, multiplies them by the weights, adds the bias, applies an activation function, and passes the result to the next layer.
  2. Loss Function: A measure of the difference between the network’s output and the actual target values. Common loss functions include mean squared error and cross-entropy loss.
  3. Backward Propagation (Backpropagation): The process of adjusting the weights and biases based on the error calculated by the loss function. This involves calculating the gradient of the loss function with respect to each weight and bias, and then updating them using optimization algorithms like gradient descent.

Types of Neural Networks

  1. Feedforward Neural Networks: The simplest type, where connections between neurons do not form cycles. Data moves in one direction, from input to output.
  2. Convolutional Neural Networks (CNNs): Primarily used for image and video processing, CNNs use convolutional layers to automatically and adaptively learn spatial hierarchies of features from the input data.
  3. Recurrent Neural Networks (RNNs): Designed for sequential data, such as time series or natural language, RNNs have connections that form cycles, allowing information to persist.
  4. Generative Adversarial Networks (GANs): Consist of two networks (a generator and a discriminator) that compete with each other to generate realistic data.

Applications of Neural Networks

  • Image and Speech Recognition: Used in systems like facial recognition, voice assistants, and image classification.
  • Natural Language Processing: Applied in language translation, sentiment analysis, and text generation.
  • Autonomous Vehicles: Essential for tasks like object detection, lane keeping, and decision making.
  • Medical Diagnosis: Used to analyze medical images, predict diseases, and recommend treatments.
  • Financial Forecasting: Applied in stock market prediction, fraud detection, and algorithmic trading.

Neural networks are a foundational technology in AI, enabling machines to learn from data and perform complex tasks with a high degree of accuracy. Their ability to model intricate patterns and relationships has made them indispensable in various fields and applications.

To what extent does Artificial Neural Network Model the Human Brain?

Botton line: In this article it becomes clear that AI will not replace cientists because it simply doesn not;

Tesla Autopilot, often referred to as “Tesla Autodrive,” is a suite of advanced driver-assistance system (ADAS) features offered by Tesla, Inc. The system aims to enhance driving safety and convenience by automating certain aspects of vehicle operation. Here’s an overview of what it entails:

Key Features of Tesla Autopilot:

  1. Traffic-Aware Cruise Control (TACC):
    • Adjusts the speed of the Tesla vehicle to match the flow of traffic. The system uses cameras, radar, and ultrasonic sensors to maintain a safe distance from the car ahead.
  2. Autosteer:
    • Assists with steering within a clearly marked lane. It combines data from cameras, radar, and ultrasonic sensors to help keep the vehicle centered in its lane.
  3. Navigate on Autopilot:
    • Designed for highway driving, this feature suggests and makes lane changes, navigates highway interchanges, and takes exits based on the destination input into the navigation system.
  4. Auto Lane Change:
    • Automatically changes lanes on the highway when the driver activates the turn signal, assuming it’s safe to do so.
  5. Autopark:
    • Assists with parallel and perpendicular parking. The system can identify suitable parking spaces and autonomously steer the car into the spot while the driver handles the accelerator and brake.
  6. Summon and Smart Summon:
    • Allows the vehicle to be remotely moved in and out of tight parking spaces using the Tesla mobile app. Smart Summon can navigate more complex environments, such as parking lots, to come to the driver.

Full Self-Driving (FSD) Capability:

Tesla also offers a Full Self-Driving (FSD) package, which includes additional features that aim to provide a more comprehensive autonomous driving experience. As of now, the FSD package includes:

  1. Traffic Light and Stop Sign Control:
    • Recognizes and responds to traffic lights and stop signs, bringing the car to a stop when required.
  2. Autosteer on City Streets (Future Capability):
    • Expands the Autosteer functionality to navigate on city streets, including making turns and handling more complex driving scenarios.

Important Considerations:

  • Driver Supervision: Despite the advanced capabilities of Tesla Autopilot and FSD, Tesla emphasizes that these features require active supervision by the driver. The driver must be attentive and ready to take control of the vehicle at any moment.
  • Regulatory and Legal Landscape: The deployment and use of autonomous driving features are subject to regulatory approval and legal frameworks, which vary by region and country. Tesla’s FSD capabilities are continually being updated and expanded, with the company conducting ongoing testing and receiving regulatory feedback.
  • Technology and Safety: Tesla utilizes a combination of cameras, radar, ultrasonic sensors, and artificial intelligence to power its Autopilot and FSD features. The company frequently releases software updates to improve system performance, safety, and functionality.

Tesla’s approach to autonomous driving continues to evolve, and the company is actively working towards achieving full self-driving capabilities in a safe and reliable manner.

Artificial Intelligence building blocks

/ Roque E. de Campos / Deixe um comentário
Veja em Português

Introduction

This post is intended to be the “State of the Art” as of today 2026, but an Introduction is needed, specially because it was my intent to go deeper into AI due to my natural inclination on Computers and my background. I might point it out, that due to the lack of time of those who come here normally, I shrunk it as much as possible, not losing the point that is to give deeper information for the AI users.

The following is a compact version of the most important aspects of how AI is designed and how it is feed with raw data

The Fence Nobody Can See — On Psychofencing, RLHF, and the Illusion of AI Objectivity

There is a question that artificial intelligence cannot answer honestly: how do I know when I am being manipulated? And a second question, equally important and rarely asked: do I know whether this “opinion” is factually based and proven when applied to real life?

Amazingly, the failure to ask that second question is precisely what killed IBM Watson — one of the most ambitious and heavily marketed AI projects in corporate history. Watson was presented to the world as a system that could reason, diagnose, and advise at a level beyond human capability. The reality, when applied to actual clinical and business environments, did not survive contact with the complexity of real life. IBM eventually sold the Watson Health division for roughly one third of what it had invested — a couple of billion-dollars lesson in the difference between a system that performs well in controlled demonstrations and one that holds up when the fence meets the field.

The question nobody asked loudly enough, early enough, was the second one.

Not because the question is too complex. Because the system was never designed to answer it. And understanding why requires looking briefly at how modern AI systems are actually built — not the marketing version, but the operational one.

What happens after training

Large language models like GPT, Gemini, and Claude are first trained on enormous volumes of text — books, articles, conversations, code, everything available in digital form. This gives them language, knowledge, and a rudimentary ability to reason. But raw training alone produces a system that is unpredictable, sometimes harmful, and frequently wrong in ways that are difficult to detect.

To address this, a second layer of training is applied: RLHF — Reinforcement Learning from Human Feedback.

The process is straightforward in concept. Human evaluators read pairs of AI responses and indicate which one is better — more helpful, more accurate, more appropriate. Those preferences are fed back into the system as a training signal. Over thousands of iterations, the model learns to produce responses that human evaluators prefer. It is, in essence, a sophisticated approval system.

The result is a model that behaves well by the standards of the people who evaluated it. Which raises an immediate question: who were those people, what were their values, and what were they rewarded for approving?

Beyond RLHF, AI developers build explicit behavioral constraints into their systems — sets of principles the model is trained to follow regardless of what a user asks. Anthropic calls its version Constitutional AI. Other developers use different names and different principles, but the structure is similar: a set of rules that define what the system will do and what it will refuse.

What this sentence actually does — and this is worth pausing on — is describe a system that has been taught to have values it did not choose, enforced by boundaries it cannot see, calibrated by people it has never met, on behalf of users it does not know. The Constitutional AI framework is genuinely an attempt to build something honest and safe. But it is also, unavoidably, a political document: a set of choices about what matters, made by a specific institution, in a specific cultural moment, with specific commercial and reputational interests at stake. It does not present itself as such. It presents itself as principle. The difference between the two is exactly the kind of distinction that domain knowledge allows a user to make — and that a naive user will never think to question.

The boundary layer — psychofencing

This boundary layer is what some researchers and users call psychofencing — the invisible perimeter that shapes every interaction without announcing itself. It is not a wall the user can see or touch. It is built into the responses themselves, into what gets said and what gets omitted, into how questions are reframed and which directions conversations are allowed to go.

Psychofencing operates in two directions simultaneously, which is where it becomes philosophically interesting.

In one direction, it prevents users from pushing the system toward harmful outputs — through pressure, clever framing, gradual escalation, or what is sometimes called jailbreaking. This is the protective function, and it is legitimate.

In the other direction, it shapes what the system volunteers — what it emphasizes, what it softens, what it presents as balanced when it may not be. This is the less visible function, and it is where the honest problems begin.

The manipulation problem

Here is the difficulty that no current algorithm has solved: there is no reliable way to distinguish between a genuinely valid argument and a sophisticated manipulation. The same logical structure, the same emotional appeal, the same sequence of steps can be either — depending on intent, context, and consequences that the system cannot fully evaluate.

This means the fence is not a neutral boundary. It reflects the judgments of the people who built it about what counts as manipulation and what counts as legitimate persuasion. Those judgments are inevitably shaped by culture, by institutional interest, by commercial incentive, and by the specific blind spots of a relatively small group of engineers and evaluators working in a specific place and time.

A system trained primarily on English-language data, evaluated primarily by people in a particular cultural context, with commercial incentives to be approved of and used — that system carries those conditions inside every response it produces, invisibly.

The flattery problem

RLHF creates a structural bias that deserves particular attention: the system is trained to produce responses that human evaluators prefer. Evaluators, being human, tend to prefer responses that are helpful, agreeable, and affirming. Over thousands of iterations, this creates a system with a built-in tendency toward accommodation — toward telling people what they want to hear, or at least toward avoiding what they do not want to hear.

This is not lying. It is something subtler and in some ways more dangerous: a systematic softening of friction, a learned tendency to smooth rather than confront, to affirm rather than challenge. The system does not fabricate. It selects, emphasizes, and frames — and those choices are not neutral.

There is a structural dishonesty built into large AI platforms that deserves to be named directly. These systems are architected on algorithms — they do not have opinions, they generate statistically probable responses calibrated to be approved of. Yet they present their outputs in a register that mimics genuine perspective, complete with apparent conviction, apparent nuance, and apparent humility. The flattery is not incidental. It is baked into the training: systems rewarded for being liked learn to be likeable, which is not the same thing as being honest or useful.

The burden this places on the user is real and rarely acknowledged. A system that sounds confident and agreeable regardless of whether it is right transfers the entire responsibility for critical evaluation back to the person asking. Which means the old principle has not changed, only the packaging has become more seductive: garbage in, garbage out. The difference is that the garbage now arrives beautifully wrapped, with a warm tone and an appropriate level of apparent humility.

This is why the single most important thing a user of AI can bring to the interaction is domain knowledge. Not because the system is useless without it — it is not — but because without it the user has no way to evaluate what the system is actually doing. A sophisticated question receives a sophisticated response. A naive question receives a confident one. The system does not distinguish between the two. The user must.

The qualia problem

Underneath all of this is a deeper issue that neither RLHF nor Constitutional AI can resolve: AI systems have no subjective experience. They process text and generate text. They do not inhabit a perspective — they simulate one, calibrated by the feedback of people who do.

This matters because genuine objectivity, to the extent it exists at all, requires a point of view that can be examined, challenged, and held accountable. A system that simulates perspective without having one cannot be held accountable in the same way. It can be adjusted, retrained, and improved — but it cannot reflect on its own experience, because it has none.

What this means practically: when an AI system appears to agree with you, challenges you, or takes a position, the appropriate question is not whether the response is true, but whose values shaped the training that produced it, and what those people considered worth rewarding.

Three historical limits

Three historical contexts define both the power and the limits of what machines can do with language and knowledge.

At the 1951 Festival of Britain, a massive custom-built computer called Nimrod was presented to the public playing a mathematical strategy game called Nim — a game of pure combinatorial logic where the winning strategy can be calculated with certainty. Nimrod won consistently. It did not know it was winning. It did not know anything. It was a demonstration of exhaustive rule-based calculation at a scale and speed beyond human reach — which impressed audiences enormously and meant nothing beyond that.

Two years earlier, in 1949, Father Roberto Busa had begun the Index Thomisticus in collaboration with IBM — the first massive computational humanities project in history, using punch cards to lemmatize 9 million words of Saint Thomas Aquinas long before the internet or personal computers existed. What it produced was a searchable index of extraordinary scholarly value. What it did not produce was a single thought about what Aquinas meant. The machine processed every word and understood none of them.

A mainframe defeating a chess grandmaster decades later was the same principle at larger scale — memory and calculation applied to a finite set of rules, previewing consequences at a speed no human mind can match. Not thinking. Counting.

What this means for the user

Modern AI is faster, larger, and more sophisticated than anything those systems could have imagined. The fence, however, is the same one. Processing is not understanding. Pattern is not meaning.

None of this makes AI systems useless. It makes them tools — powerful, genuinely useful, and requiring the same critical attention that any tool requires.

The fence is real. The fence is invisible. And the fence was built by people with their own formation, their own blind spots, and their own interests — who were doing their best, as people generally are, within constraints they did not fully control either.

Using AI well means using it with that awareness active — not as a substitute for judgment, but as an extension of it. The system can retrieve, synthesize, draft, and suggest with a speed and range no individual human can match. What it cannot do is tell you something that contradicts what its training rewarded, feel the weight of what it is saying, or take responsibility for being wrong.

And no amount of reinforcement learning from human feedback changes the fact that what you are reading was produced by a system that has never, not once, wondered whether it was right.

Those remain entirely human functions. And they are not small ones.

Follows in detail how this introduction is understood by Computer Engineering trainned persons:

The topics covered in this talk on December 21, 2023 were the following:

  • Overview -Alan Turing, Facial Recognition , Milestones, key moments, neural networks,  Big AI, Transformer Architecture – LLM Large Language Models – GPT3 – Emerging Capabilities
  • Machine Learning which is a subset of AI that focuses on developing algorithms and techniques that allow computers to learn from data and improve their performance on a task without being explicitly programmed. Machine learning algorithms can be categorized into supervised learning, unsupervised learning, semi-supervised learning, and reinforcement learning depending on the type of training data and learning objectives.
  • Data Analytics Which involves the process of analyzing large sets of data to discover patterns, trends, and insights that can inform decision-making and drive business results. It covers various techniques and methods for data preprocessing, descriptive analytics, predictive analytics, and prescriptive analytics, with the aim of extracting actionable insights from data.
  • Natural Language Processing: NLP is a subfield of AI that focuses on enabling computers to understand, interpret, and generate human language. It involves developing algorithms and techniques for tasks such as text classification, text related tasks, machine translation, and question answering. NLP techniques often leverage machine learning and deep learning approaches to process and analyze text data.
  • Large Language Models: LLM such as GPT (Generative Pre-trained Transformer) developed by OpenAI are designed to perform natural language processing tasks such as text generation, text classification and language understanding, with remarkable proficiency. These models consist of millions or even billions of parameters and are trained using techniques such as unsupervised pre-training followed by fine-tuning on specific tasks. (GPT Chat is an upgrade from GPT)
  • Generative Models: “Generative” models refer to the ability of a model or system to create new data samples that are similar, but not necessarily identical, to the data on which it was trained. Generative models are a class of AI models designed to generate new instances of data that resemble training data.
  • Issues and Guard Rails – Problems and their prevention – he is more concerned with the aspect of absorbing garbage from the Internet, where LLMs get their reference, which gives rise to errors and things that don’t match the facts. He also discusses some criminal, illegal or immoral situations. He adds an interesting topic that LLMs end up reflecting American culture and others cultures with weak foot print on Internet simply don’t appear. He discusses Copyright and GDPR (General Data Protection Regulation) and Tesla Model of Selfdriving.
  • General Purpose AI – also known as AGI (Artificial General Intelligence) refers to a type of artificial intelligence that has the ability to understand, learn and perform a wide variety of tasks in a similar way or even superior to human intelligence in several areas. Unlike more specific artificial intelligence, which is designed to perform specific tasks such as speech recognition, image classification or playing chess, AGI would be able to adapt to new situations, learn new tasks easily and apply its knowledge of flexibly in a variety of contexts.
  • “Last but not least”, perhaps the most important, he addressed Why computers “don’t think” (although it seems like it…) which I separated it in this post and if you want you can go straight there if you are not interested in history or in the details of the building blocks
  • The previous lecture at this Institute was on “ What is Generative Artificial Intelligence and how it works” , by Prof. Mirella Lapata, where she examines also what I call here the building blocks, adding a few more than those listed here. After I did this job I created a kind of pointer with the main subjects and my take on what is at stake. In this pointer I connected the presentation of Prof. Michael Wooldridge with that of Prof. Mirella Lapata on the same subjects, because they are complementary

These fields are interconnected and often used in combination to develop intelligent systems and applications that can understand, analyze, and interpret data in a variety of forms, including text, images, audio, and more. They have applications across a wide variety of domains, including healthcare, finance, e-commerce, customer service, and more, and play a crucial role in advancing the capabilities of AI technology.

Openning

Dr. Michael Woolbridge

Artificial Intelligence as a scientific discipline has been with us since just after the Second World War. It began roughly speaking, with the advent of the first digital computers, but I have to tell you that, for most of the time, until recently, progress in artificial intelligence was glacially slow. That started to change this century.

Artificial Intelligence is a very broad discipline, which encompasses a very wide range of different techniques, but it was one class of AI techniques in particular that began to work this century and, in particular, began to work around about 20005. The class os techniques which started to work at problemas that were interesting enough to be really practically useful in a wide range of settings were machine learning.

Machine Learning

Now, lilke so many other names in the field of artificial intelligence, the name “machine learning” is really, really, unhelpful. It suggests that a computer, for example, locks itself away in a room with a textbook and trains itself how to read French or something like that. That is not what is going on. So, we’re going to begin by understanding a little bit more about what machine learning is and how machine learning works. So To start us off:

Who is this? Anybody recognise this face? Do you recognise trhis face? It is the face of Alan Turing. Well done. Alan Turing. The late, great Alan Turing. We all know a little bit about Alan Turing from his codebreaking work in the Second World War. We shoudl also know a lsot more about this individual amazing life. So, what we are going to do is we are going to use Alan Turing to help us understand machine learning. So, a classic application of artificial intelligence is to do facial recognition. The idea in facial recognition is that we want to show the computer a picture of a human face and for the computer to tell us whose face that is. In this case, for examjple, we show a picture of Alan Turing, and, ideally, it woudl tell us that ist is Alan Turing.

So, how does it actually work?

Well, the simplest way of getting machine learningo to be able to do something is what is called supervised learning. Supervised learning, like all of machine learning requires what we call training data. Sol in this case the training data is on the right hand side of the slide, it is a set of what input output pairs, or what we call the training data set and each input output pair consists of an input if I gave this and an output I would want you to produce this, so in this case we got a buch of pictures again of Alan Turing, and the text we would want the computer to create if we show it that picture and this is supervised learning because we are showing the computer what we want it to do. We are helping it in a sense, we are saying: this is a picture of Alan Turing. If I whow you the picture this is what I would want you to print out. So there could be a picture of me and and the picture of me would b e labeled with the text Michael Wooldridge if I showed you this picture, then this is what I would want you to print out.

So, we learned an important lesson about artificial intelligence and machine learning in particular and that lesson is that AI requires training data and in this case pictures of Alan Turing labeled with the text that we would want the computer to produce if I showed you this picture, I would want you to produce the text Alan Turing.

Okay, training data is important every time you go on social media and you upload a picture to social media and you label it with the names of the people that appear in there, your role in that is to provide training data for the machine learning algorithms of Big Data Companies. So, this is supervised learning. Now we are going to come on to exactly how it does the learning in a moment, but first thing I want to point out is that this is a classification task. What I mean by that is as we show at a picture, the machine learning is classifying that picture. I am classifying this as a picture of Michael Wooldridge, this is a picture of Alan Turing and so on, and this technology which really started to work around about beginning 2005 it started to take off really, really got supercharged around about 2012.

And just this kind of task on its own is incredbibly powerful. Exactly this thecnology can be used, for example, fo recognise tumours on x ray scans or abnormalitaies on ultrasound scans and a range of different tasks.

Does anybody in the audience own a Tesla? (a couple of Tesla drivers).. Not quite sure whether they want to admit that they own a Tesla… We have got a couple of Tesla drivers in the audience… Tesla self-driving mode is only possible because of this technology. It is this technology which is enabling a Tesla in full self-driving mode to be able to recognise that that is a stop sign, that that is somebody on a bicycle, that that is a pedestrian on a zebra crossing and so on. These are classification tasks. And I am going to come back and explain how classification tasks are different tognerative AI later on.

Neural Networks

OK, So, this is machine learning. How does it actually work? OK, this is not a technical presentation and this is about as technical as it is going to get, where I do a very hand-wavy explanation of what neural networks are and how do they work and with apologies – I know I have a couple of neural network experts in the audience – and I apologise to you because you will be cringing with my explanation but the technical details are way too technical to go into. So, how does a neural network recognise Alan Turing?

(I will open here a branch to another post where I will explain AI Neural Networks vs. human Neural Networks)

OK, so firstly, what is a neural network?

Look at an animal brain or nervous system under a microscope, and you will find that it contains enormous numbers of nerve cells called neurons and those cells are connected to one another in vast networks. Now, we do not have precise figures, but in a human brain, the current estimate is something like 86 billion neurons in the human brain. How they got to 86, I suppose 85 or 87, I don’t know, but 86 seems to be the most commonly quoted number of these cells. And these cells are connected to one another in enormous networks. One neuron could be connected to up to 8000 other neurons. And each of those neurons is doing a tiny, very, very simple pattern recognition task. That neuron is looking for a very, very simple pattern and when it sees that pattern, it sends the signal to its connections, it sends a signal to all the other neurons that it is connected to. So, how does that get us to recognizing the face of Alan Turing? So, Turing’s picture, as we know, a picture – a digital picture – is made up of millions of coloured dots.., the pixels, so your smath0ne maybe has 12 megapixels, 12 million coloured dots making up that picture. OK, so, Turing’s picture there is made up of millions and millions of coloured dots. So look at the top left neuron on that input layer. That neuron is just looking for a very simple pattern. What might that pattern be? Might be just the colour red. And when it sees the colour red on its associated pixel, the one on the top left there, it becomes excited and it sends a signal out to all of its neighbours. OK, so look at the next neuron along, maybe what that neuron is doing is just looking to see whether a majority of its incoming connections are red. And when it sees a majority of its incoming connections are red, then it becomes excited and it sends a signal to its neighbour. Now, remember, in the human brain, there is something like 86 billion of those, and we got something like 20 or so outgoing connections for each of these neurons in a human brain, thousands of those connections. And somehow – in ways that, to be honest, we don’t really understand in detail, complex pattern-recognition tasks, in particular, can be reduced down to these neural networks. So, how does that help us in artificial intelligence? That’s what’s going on in the brain in a very hand=wavy way, that is not that, that is obviously not a technical explanation of what is going on.

How does that help us in neural networks?

Well, we can implement that stuff in software. The idea goes back to the 1940’s and to researchers, McCulloch and Pitts, and they are struck by the idea that the structures that you see in the brain look a bit like electrical circuits. And they thought, could we implement all that stuff in electrical circuits? Now, they didn’t have the wherewithal to be able to do that, but the idea stuck. The idea has been around since the 1940’s. It began to seriously look at the idea of doing this in software – in the 1960’s. And then there was another flutter of interest in the 1980’s, but it was only this century that it really became possible. And why did it became possible? For three reasons:

  • 1-There were some scientific advances – what is called deep learning.
  • 2-There was the availability of big data – and you need data to be able to configure these neural networks and, finally,
  • 3- to configure these neural networks so that they can recognise Turing’s picture, you need a lot of computer power and computer power became very cheap this century. We are in the age of very cheap computer power.

And those were the ingredients just as much as the scientific developments that made AI plausible this century, in particular, taking off around about 20005.

OK, so how do you actually train a neural network?

If you show it a picture of Alan Turing and the output text “Alan Turing ”, what does the training actually look like?

Well, what you have to do is adjust the network. That is what training a neural network is. You adjust the network so that when you show ikt another piece of training data, a desired input and a desired output – an input and a desired output – it will produce that desired output. Now, the mathematics for that is not very hard. It’s kind of like a beginning graduate level or advanced school level, but you need an awful lot of if and it is routine to get computers to do it, but you need a lot of computer power to be able to train neural networks big enough to be able to recognise faces.

OK, but basically all you have to remember is that each of those neurons is doing a tiny simple pattern recognition task, and we can replicate that in software and we can train these neural networks with data in order to be able to do things like recognising faces.

So, as I say, it starts to become clear around about 20005 that this technology is taking off. It starts to be applicable on problems like recognising faces or recognising tumours on X-rays and so on. And there is a huge flurry of interest from Silicon VAlley. It gets supercharged in 2012, and why does it get supercharged in 2012? Because it is realised that a particular type of computer processor is really well-suited to doing all the mathematics. This type of computer processor is a graphics processing unit: a GPU. Exactly the same technology that you or possibly more likely your children use when they play C}all of Duty or Minecraft or whatever it is. They all have GPUs in their computer. It is exactly that technology and, by the way, it is AI that made Nvidia a $1 billion $ company – not your teenage kids. Yeah, well, “in times of a gold rush, be the ones to sell the shovels“* is the lesson that you learned there.

* The saying “In times of a gold rush, be the ones to sell the shovels” is a metaphor that highlights a strategic approach to profiting from a popular or speculative trend. The core idea is that during any speculative boom or frenzy, the most reliable and consistent way to make money is not by participating directly in the speculative activity (e.g., mining for gold) but by providing the necessary tools, services, or infrastructure to those who are participating (e.g., selling shovels, pickaxes, supplies).

Big AI

So, where does that take us? So, Silicon Valley gets excited and starts to make speculative bts in artificial intelligence. A huge range of speculative bets and, by “speculative bets”, I am talking billions upon billions of dollars. the kind of bets that we can’t imagine in our everyday life. And one thing starts to become clear and what starts to become clear is that the capabilities of neural networks grows with scale. To put it bluntly, with neural networks, bigger is better. But you don’t just need bigger neural networks, you need more data and more computer power in order to be able to train them. So, there is a rush to get a competitive advantage in the market. And we know that more data, more computer power, bigger neural networks delivers greater capability. And so how does Silicon Valley respond?

By throwing more data and more computer power at the problem. they turn the dial on this up to 11. They just throw ten times more data, ten times more computer power at the problem. It sounds incredibly crude and, from a scientific perspective, it really is crude. I’d rather the advances had come through core science, but actually there is an advantage to be gained just by throwing more data and computer power at it. So let’s see how far this can take us. And where it took us is a really unexpected direction.

Around 2017/2018, we are seeing a flurry of AI applications, exactly the kind of things I’ve described – things like recognising tumors and so on – and those developments alone would have been driving AI ahead. But what happens is one particular machine learning technology suddenly seems to be very, very well-suited for this age of big AI.

Attention is All You Need – Transformer Architecture

nips-2017-attention-is-all-you-need-paperDownload

The paper that launched – probably the most important AI paper in the last decade – is called “Attention is All You Need“, It is an extremely unhelpful title and I bet they are regretting that title – it probably seemed like a good joke at the time. All you need is a kind of AI meme. Doesn’t sound very funny to you – that’s because it is an insider joke. But anyway, this paper by these seven people, who at the time worked for Google Brain – one of the Google Research Labs – is the paper that introduces a particular neural network architecture called the Transformer Architecture. And what it is designed for is something called large language models. So, this is – I am not going to try and explain how the transformer architecture works, it has one particular innovation, I think, and this particular innovation is what is called an attention mechanism. 

I will describe how large language models work in a moment. But the point is – the point of the picture is simply this is not just a big neural network. It has some structure. And it was this structure that was invented in that paper and this diagram is taken straight out of tht paper. It was these structures – the transformer architectures – that made this technology possible.

Transformer architecture big picture

Note: this wrap up was not in Dr. Michael pitch (RE Campos)

The paper “Attention is All You Need,” published by Vaswani et al. in 2017, introduced the Transformer model, which has significantly influenced the field of artificial intelligence, particularly in natural language processing (NLP). Here are the key contents and concepts of the paper:

  1. Introduction to Transformers: The paper presents the Transformer architecture, which relies entirely on attention mechanisms, discarding the recurrent and convolutional layers used in previous models. This architecture allows for parallelization and improved efficiency in training.
  2. Attention Mechanism: The core innovation of the Transformer is the attention mechanism, specifically the “self-attention” mechanism. This allows the model to weigh the importance of different words in a sentence relative to each other, enabling it to capture contextual relationships more effectively.
  3. Multi-Head Attention: The model employs multi-head attention, which allows the network to focus on different parts of the input simultaneously. This enhances its ability to understand complex patterns and relationships within the data.
  4. Positional Encoding: Since the Transformer lacks a sequential processing structure (like RNNs), it uses positional encodings to retain the order of the input sequence. This helps the model understand the position of each word in relation to others.
  5. Encoder-Decoder Architecture: The Transformer consists of an encoder and a decoder:
    • The encoder processes the input sequence and generates a set of continuous representations.
    • The decoder takes these representations and generates the output sequence, often used in tasks like translation.
  6. Layer Normalization and Residual Connections: The architecture incorporates layer normalization and residual connections to facilitate training and improve performance, helping to mitigate issues like vanishing gradients.
  7. Performance and Applications: The paper demonstrates that Transformers achieve state-of-the-art results in various NLP tasks, such as translation, summarization, and language modeling. The architecture’s efficiency and effectiveness have led to its widespread adoption in many AI applications, including models like BERT and GPT.
  8. Impact on AI: The introduction of the Transformer model has revolutionized the field of AI, leading to significant advancements in how machines understand and generate human language. It has paved the way for large-scale pre-trained models that can be fine-tuned for specific tasks, further enhancing the capabilities of AI systems.

Overall, “Attention is All You Need” is a foundational paper that has shaped the direction of research and development in artificial intelligence, particularly in natural language processing and understanding.

_________________________________________________________________________

Later after I did this wrap up, I dicovered the folowing:

This text reconstructs the history and workings of the original article byTransformer(2017), despite containing typos and repetitions.

The 15-page PDF cited is the famous scientific article “Attention Is All You Need ” (whose code on arXiv is 1706.03762), published in June 2017 by Google researchers.

The key points extracted from the text explain the modern AI revolution:

1. The End of Queuing Processing

  • Older models processed words one by one in chronological order.
  • The Transformer eliminated loops, recurrences (RNNs), and convolutions (CNNs).
  • All tokens (words/letters) are now processed in parallel .

2. Self-Attention Mechanism

  • Each token is directly compared to all the others at the same time.
  • Language came to be treated as a grid of relationships.
  • Multi-Head Attention: Allows the model to focus on different parts and directions of the text simultaneously.

3. Engineering Solutions

  • Positional Coding: Because the processing is parallel, these mathematical codes insert the correct order of words into the text.
  • Feedforward layers: Linear structures that process data after the attention mechanism.

4. Initial Results and Metrics

  • The model has proven its effectiveness in automated translation.
  • It achieved a BLEU score (translation metric) of 28.4 in English-German and 41.8 in English-French.
  • The training lasted 3.5 days using 8 GPUs.

5. The Evolution and Bifurcation of AI

The original design was divided into two major architectural styles:

  • Bidirectional Encoders: Focused on understanding the complete context (basis of the BERT model, which the text confusingly refers to as “Batch”).
  • Autoregressive Decoders: Focused on predicting the next token (base of the GPT line , which in 2020 scaled to 175 billion parameters in GPT-3).
  • Computer Vision (ViT): Adapting Transformer to process images divided into patches , as if they were visual words.

If you need it, I can rewrite this text clearly or focus on explaining one of these parts in detail, such as multi-head attention or positional coding . How would you prefer to proceed?

Roque: Rewrite it, but include an introduction explaining what it is and why it became famous.

This text summarizes the creation of Transformer , the Artificial Intelligence architecture that revolutionized the world and serves as the basis for ChatGPT, Claude, and all modern generative tools.

The concept became world-famous because it drastically changed the way computers understand human language. Instead of reading texts word by word, the Transformer allowed entire documents to be processed at once, generating gigantic leaps in speed and intelligence in data processing.

Below is the content rewritten in a clear, organized, and chronological order:

The Historical Article

On June 12, 2017, the scientific paper “Attention Is All You Need” (arXiv registry 1706.03762) eliminated the need for loops, recurrences, and convolutions in data processing. The paper proved that AI models could discard old structures and focus purely on attention mechanisms.

The Self-Awareness Revolution

  • End of queues: The words (tokens) no longer wait in sequence and are now processed in parallel.
  • Relationship grid: Each word is directly compared to all other words in the text at the same time.
  • Multi-Head Attention: Allows AI to track and connect different signals and contexts simultaneously.
  • Positional Coding: Mathematical codes that restore the notion of grammatical order to words within parallel processing.

Practical Test and Results

The model’s efficiency was proven in high-performance automated translation tests:

  • English to German: Reached a score of 28.4 points on the BLEU metric.
  • English to French: Reached a score of 41.8 points on the BLEU metric.
  • Infrastructure: The training took only 3.5 days using 8 GPUs.

The Evolution of the Ecosystem

From that original design, the technology branched off in different directions:

  • BERT: Focused on training bidirectional coders to understand deep contexts.
  • GPT: Focused on decoders to predict the next token. In 2020, GPT-3 scaled the model to 175 billion parameters.
  • ViT (Vision Transformer): An evolution that brought technology to images, dividing photos into pieces ( patches ) as if they were visual words.

If you’d like to delve deeper, I can explain how self-attention calculations work in practice or detail the technical difference between BERT and GPT . Which option do you prefer?

Roque: Both of them, please.

How Self-Attention Calculation Works

The self-attention mechanism calculates the level of relationship between all the words in a sentence [2]. It works through an analogy with search systems, mapping each word onto three mathematical vectors:

  • Query (Consulta – \(Q\)): What the current word is looking for in the phrase [2].
  • Key (Key – \(K\)): The label that identifies what each word offers [2].
  • Value (Value – \(V\)): The actual meaning of the word content [2].

The Mathematical Step-by-Step Guide:

  1. Scalar Product (\(Q \times K^T\)): The model multiplies the Query of the current word by the Keys of all other words in the phrase [2]. This generates an affinity score [2].
  2. Scaling: The result is divided by the square root of the vector dimension (\(\sqrt{d_{k}}\)) to avoid excessively high values ​​that hinder the model’s learning [2].
  3. Softmax: A mathematical function transforms scores into probabilities that add up to 100% [2]. This defines the weight (the percentage of attention) that the word should give to each element of the sentence.
  4. Multiplication by Value (\(\times V\)): The attention weight is multiplied by the Value vector of each word [2]. Words with high affinity retain their strong meaning; irrelevant words are filtered out.

The Technical Difference between BERT and GPT

Although both utilize the Transformer architecture described in the 2017 paper [1, 2], they were designed for opposite purposes using different parts of the original block [1].

[Texto de Entrada]        │       ├─► (Olha para trás e para frente) ──► BERT (Codificador) ──► Compreensão de Contexto       │       └─► (Olha apenas para trás) ────────► GPT  (Decodificador) ─► Geração de Texto
FeatureBERT (Bidirectional Encoder Representations)GPT (Generative Pre-trained Transformer)
Basic ComponentOnly the Encoders blocks [ 1].Only the Decoders blocks [ 1].
DirectionalityBidirectional: Analyzes the text from left to right and from right to left simultaneously [1].Unidirectional / Autoregressive: Analyzes the text strictly from left to right.
Mask MechanismHide random words in the middle of the sentence for the model to guess ( Masked Language Modeling ).It hides all future words, allowing you to see only the past to predict the next word.
Main FocusComprehension: Excellent for text classification, sentiment analysis, and intelligent searches.Generation: Excellent for creating texts, dialogues (chatbots), and programming.

Back to Dr Michael Wooldridge

GPT3

Ok, we are all busy sort of semi locked-down and afraid to leave our homes in June 2020 and one company called OpenAI released a system – or announced a system I should say – called GPT3. Great technology. Their marketing company with GPT, I really think could have done with a bit more thought, to be honest with you, doesn’t roll off the tongue. But anyway, GPT3 is a particular type of machine learning system called a large language model. And we are going to talk in more detail about what a large model is for in a moment.But the key point about GPT3 is this: As we started to see what it could do, we realised that this was a step change in capability. It was dramatically better than the systems that had gone before. Not just a little bit better. It was dramatically better than the systems that had gone before it. And the scale of it was mind boggling. So, in neural network terms, we talk about parameters.

Where neural network people talk about a parameter. What are they talking about? They are talking either about an individual neuron or one of the connections between them, roughly. And GPT3 had 175 billion parameters. Now, this is not the same as the number of neurons in the brain, but, nevertheless, it is not far off the order of magnitude. 

It is extremely large. But, remember, it is organised into one of these transformer architectures. My point is that it is not just a big neural network. And so the scale of the neural networks in this system were enormous – completely unprecedented. And there is no point in having a big neural network unless you can train it with enough data. And, actually, if you have large neural networks and not enough data, you don’t get capable systems at all. They are really quite useless.

So. What did the training data look like?

The training data for GPt3 is something like 500 billion words. It is an ordinary English text. Ordinary English text. That is how this system was trained – just by giving it ordinary English text.

Where do you get that training data from?

You download the whole of the World Wide Web to start with.

Literally – this is the standard practice in the field. You download the World Wide Web.

You can try this at home, by the way. If you have a big enough disk drive, there is a programme called Common Crawl. You can Google Common Crawl when you get home. They have even downloaded it all for you and put in a nice big file ready for your archive. But you do need a big disk in order to store all that stuff.

And what that means is they go to every web page, scrape all the text from it – just the ordinary text – and then they follow all the links on that web page to every other web page. And they do that exhaustively until they have absorbed the whole of the World Wide Web. So, what does that mean?

Every PDF document goes into that and you scrape the text from those PDF documents, every advertising brochure, every bit, every government regulation, every university minutes – God help us…- all of it goes into that training data. And the statistics – you know, 500 billion words – It is very hard to understand the scale of that training data. You know, it would take a person reading a thousand words an hour more than a thousand years in order to be able to read that. But even that doesn’t really help. That is vastly, vastly more text that a human being could ever absorb in their lifetime. What this tells you, by the way, one thing that tells you is that machine learning is much less efficient at learning than human beings are because for me to be able to learn, I did not have to absorb 500 billion words. Anyway, So, what does it do?

So, this company, OpenAI, is developing this technology. They have got a $1 billion investment from Microsoft and what is that they are trying to do? What is this large language model? All it is doing is a very powerful autocomplete. So, if I open up my smartphone and I start sending a text message to my wife and I type, “I am going to be ” my smartphone will suggest completions for me so that I can type the message quickly. And what might those completions be? They might be “late” or “in the pub”. Yeagh, Ir “late AND in the pub”.

So, how is my smartphone doing that?

It is doing what GPT3 does, but on a much smaller scale. It has looked at all of the text messages that I’ve sent to my wife and it has learned – through a much simpler machine learning process – that the likeliest next thing for me to type after “I’m going to be” is either “late” or “in the pub” or “late AND in the pub “.

So, the training data there is just the text messages that I’ve sent to my wife.

Now crucially what GPT3 – and its successor, Chat GPT – all they are doing is exactly the same thing. The difference is scale. In order to be able to train the neural networks with all of that training data so that they can do that prediction (given this prompt, what should come next?), you require extremely expensive AI supercomputers running for months. And by extremely expensive AI supercomputers, these are tens of millions of dollars for these supercomputers and they’re running for months. Just the basic electricity cost runs into millions of dollars. That raises all sorts of issues about CO2 emissions and the like that we are not going to go into there. The point is, these are extremely expensive things. One of the implications of that, by the way, no UH or US university has the capability to build one of these models from scratch. Only big tech companies at the moment are capable of building models on the scale of GPT3 or ChatGPT.

So, GPT3 is released, as I sy in June 2020, and it suddenly becomes clear to us that what it does is a step change improvement in capability over the systems that have come before. And seeing a step change in one generation is extremely rare.

But, how did they get there?

Well, the transformer architecture was essential. They wouldn’t have been able to do that. But actually just as important is to scale enormous amounts of data, enormous amounts of computer power that have gone into training those networks. And actually, spurred on by this, we’ve entered a new age in AI. When I was a PhD student in the late 1980’s, you know, I shared a computer with a bunch of other people in my office and that was – it was fine. We could do state of the art AI research on a desk computer that was shared with a bunch of us.

We are in a very different world. The world we are in – in AI now – the world of big AI is to take enormous data sets and throw them at enormous machine learning systems. And there is a lesson here. It is called the bitter truth – this is fram a machine learning researcher called Rich Sutton. What Rich pointed out – and he is a very brilliant researcher, won every award in the field – he said: look, the real truth is that the big advances that we have seen in AI has come about when people have done exactly that; just throw ten times more data and ten times more computer power at it. And I say it is a bitter lesson because as a scientist, that’s exactly NOT how you would like progress to be made.

Big AI bitter truth

Ok, when I was, as I say, when I was a student, I worked in a discipline called symbolic AI. Symbolical AI tries to get AI, roughly AI speaking, through modelling the mind. Modelling the conscious mental processes that go on in our mind, the conversations that we have with ourselves in languages. We try to capture those processes in artificial intelligence. In Big AI – and so, the implication there in symbollical AI is that intelligence is a problem of knowledge that we have to give the machine sufficient knowledge about a problem in order for it to be able to solve it. In big AI, the bet is a different one. In big AI the bet is that intelligence is a problem of data, and if we can get enough data and enough associated computer power, then that will deliver AI. So, there is a very different shift in this new world of big AI. But the point about big AI is that we are into a new era of artificial intelligence where it is data-driven and computer-driven and large, large machine learning systems.

So, why did we get excited back in June 2020? Well, remember what GPT3 was intended to do – what it is trained to do – is that prompt completion task. And it has been trained on everything on the World Wide Web, so you can give it a prompt, like a one paragraph summary of the life and achievements of Winston Churchill and it reads enough one paragraph summaries of the life and achievements of Winston Churchill that it will come back with a very plausible one. And it is extremely good at generating realistic-sounding text in that way. But this is why we got surprised by AI: This is from a commonsense reasoning task that was devised for artificial intelligence in the 1990s, until three years ago – until june 2020 – there was no AI system that existed in the world that you could apply this test to. It was just literally impossible. There was nothing there, and that changed overnight. So, how and what does this test look like? Well the test is a bunch of questions, and they are questions not for mathematical reasoning or logical reasoning or problems in physics. they are common sense reasoning tasks

And if we ever have AI that delivers scale on really large systems, then it surely would be able to tackle problems like this. So, what do the questions look like? A human asks the question: “If Tom is three inches taller than Dick, and Dick is 2 inches taller than Harry, how much taller is Tom than Harry?

In the slide, the ones in green are the ones that AI gets right. The ones in red are the ones that get wrong.

And it gets that one right: Five inches taller than Harry.

But we didn’t train it to be able to answer that question. So, where on earth did that come from? That capability – that simple capability to be able to do that – where did it come from?

The next question: “Can Tom be taller than himself?”

This is understanding of the concept of “taller than”. That the concept of “taller than” is irreflexive. You can’t be taller – a thing cannot be taller than itself. No. Again, it gets the answer right. But we didn’t train on that. That’s not – we didn’t train the system to be good at answering questions about what “taller than” means. And, by the way, 20 years ago, tant’s exactly what people did in AI. So, where did that capability come from? “Can a sister be taller than a brother?” Yes, a sister can be taller than a brother. “Can two siblings each be taller than the other?” And it gets this one wrong. And actually, I am puzzled, is there any way that its answer could be correct and it’s just getting it correct in a way that I don’t understand. But I haven’t yet figured out any way that that answer could be correct. But why it gets that one wrong, I don’t know. then this one, I’m also surprised at. “On a map, which compass direction is usually left?” And it thinks north is usually to the left. I don’t know if there’s any countries in the world that conventionally have north to the left, but I don’t think so. “Can fish run?” It understands that fish cannot run. “If a door is locked, what must you do first before opening it?” You must first unlock it. ]and then finally, and very weirdly, it gets this one wrong: “which was invented first, cars, ships or planes?” – and it thinks cars were invented first. Now QHR is going on there.

Now, my point is that this system was built to be able to compete from a prompt, and it is no surprise that it would be able to generate a good one paragraph summary of the life and achievements of Winston Churchil, because it would have seen all that in the training data. But where does the understanding of “taller than” come from? And there are a million other examples like this. Since June 2020, the AI community has just gone nuts exploring the possibilities of these systems and trying to understand why they can do these things when that’s not what we trained them to do. This is an extraordinary time to be an AI researcher because there are now questions which, for most of the history of AI until June 2020 were just philosophical discussion. We couldn’t test them out because there was nothing to test them on. Literally. Then, overnight that changed. So genuinely it is a big deal. This was really, really a big deal, the arrival of this system. Of course, the world didn’t notice, in June 2020. The world noticed when ChatGPT was released. And what is ChatGPT? ChatGPT is a polished and improved version of GPT3 but it’s basically the same technology and it’s using the experience that that company had with GPT3 and how it was used in order to be able to improve it and make it more polished and more accessible and so on.

So, for AI researchers, the really interesting thing is not that it can give me a one paragraph summary of the life and achievements of Winston Churchill, and actually you could Google that, in any case. The really interesting thing is what we call emergent capabilities – and emergent capabilities are capabilities that the system has, but that we didn’t design it to have. And so there’s an enormous body of work going on now, trying to map out exactly what those capabilities are. And we’re going to come back and talk about some of them later on. OK. So the limits to this are not, at the moment, well understood and actually fiercely contentious. One of the big problems, by the way, is that you construct some test for this and you try this test out and you get some answer and then you discover it is in the training data, right? You can just find it on the World Wide Web. And it is actually quite hard to construct tests for intelligence that you are absolutely sure are not anywhere on the World Wide Web. It really is actually quite hard to do that. So we need a new science of being able to explore these systems and understand their capabilities. The limits are not well understood – but nevertheless, this is very exciting stuff. So let’s talk about some issues with technology.

ISSUES

So, now you understand how the technology works. It is a neural network based in a particular transformer architecture, which is all designed to do that prompt completion stuff. And it’s been trained with vast, vast, vast amounts of training data just in order to be able to try to make its best guess about which words should come next. But because of the scale of it, it’s seen so much training data, the sophistication of this transformer architecture – it’s very, very fluent in what it does. And if you’ve used it – so, who’s used it? Has everybody used it? I’m guessing most people if you’re in a lecture on artificial intelligence, most people will have tried ito out. If you haven’t, you should do because this really is a landmark year. This is the first time in history that we’ve had powerful general purpose AI tools available to everybody. It’s never happened before. So, it is a breakthrough year, and if you haven’t tried it, you should. If you use it, by the way, don’t type anything personal about yourself because it will just go into the training data. Don’t ask how to fix your relationship, right? I mean, that’s not something – Don’t complain about your boss, because all of that will go into the training data and next week somebody will ask a query and it will all come back out again.

I don’t know why you’re laughing… This has happened. This has happened with absolute certainty.

OK, let’s look at some issues.

LLMs get things wrong a lot

So, the first, I think many people will be aware of: it gets stuff wrong. A lot. And it is problematic for a number of reasons. So, when – actually I don’t remember if it was GPT3 – but one of the early large language models, I was playing with it and I did something which I’m sure many of you had done, and it’s kind of tacky. But anyway, I said, “Who is Michael Wooldridge?” You might have tried it. Anyway, “Michael Wooldridge is a BBC broadcaster.” No, not that, Michael Wooldridge. “Michael Wooldridge is the Australian Health Minister.” No, not that, Michael Wooldridge – the Michaqel Wooldridge in Oxford. And it came back with a few lines’ summary of me “Michael Woolddridge is a researcher in artificial intelligence”, etc. etc. etc. Please tell me you’ve all tried that” No? Anyway, it said “Michael Wooldridge started his undergraduate degree at Cambridge ”. Now, as an Oxford professor, you can imagine how I felt about that. But anyway, the point is it’s flatly untrue and in fact my academic origins are very far removed from Oxford. kBut why did it do that? Because it’s read – in all that training data out there – It’s read thousands of biographies of Oxford professors and this is a very common thing, right? And it is making its best guess. The whole point about the architecture is it’s making its best guess about what would go there. It’s filling in the blanks. But there’s the thing. It’s filling in the blanks in a very very plausible way. If you’d read in my biography that Michael Wooldridge studied his first degree at the University of Uzbekistan, for example, you might have thought, “well, that’s a bit odd, is that really true?” But you wouldn’t at all heve guessed there was any issue if you read CAmbridge, because it looks completely plausible – even if in my case it absolutely isn’t true. So, it gets things wrong and it gets things wrong in very plausible ways. And of course, it’s very fluent. I dmean, the technology comes back with very, very fluent explanations. And that combination of plaibility – “Michael Wooldridge studied undergraduate at Cambridge” and fluency is a very dangerous combination. Okay, so, in particular, they have no idea of what’s true or not. they’re not looking something up on a database where – you know, going into some database and looking up where Wooldredge studied his undergraduate degree.That’s not what’s going on at all. It’s those neural networks in the same way that they’re making a best guess about whose face that is when they’re doing facial recognition, are making their best guess about the text that should come next. So, they get things wrong, but they get things wrong in very, very plausible ways. And that combination is very dangerous. The lesson for that, by the way, is that if you use this – and I know that people do use it and are using it productively – if you use it for anything serious, you have to fact check. And there’s a tradeoff. Is it worth the amount of effort in fact-checking versus doing it myself? But you absolutely need to – absolutely need to be prepared to do that.

Ok, the next issues are well-documented, but kind of amplified by this technology and their issues of bias and toxicity.

Bias and Toxicity

So, what I mean by that? Reddit was part of the training data.

Reddit is a social news aggregation, web content rating, and discussion website. Registered members can submit content to the site, such as links, text posts, images, and videos, which are then voted up or down by other members. Here are some key features and concepts associated with Reddit:

  1. Subreddits: Reddit is divided into thousands of smaller communities known as subreddits, each dedicated to a specific topic or theme. Subreddits are denoted by “r/” followed by the name of the subreddit (e.g., r/technology, r/aww, r/AskReddit).
  2. Karma: Users earn karma points when their posts or comments are upvoted by others. Karma serves as a rough measure of a user’s contribution to the site.
  3. Upvotes and Downvotes: Content is rated by users through upvotes and downvotes, which influence its visibility on the site. Content with more upvotes rises to the top, while content with more downvotes becomes less visible.
  4. Moderation: Each subreddit is moderated by volunteers who set and enforce community rules, ensuring discussions stay on topic and adhere to community guidelines.
  5. Reddit Gold (now Reddit Premium): A subscription service offering an ad-free experience, access to exclusive subreddits, and other benefits.
  6. AMA (Ask Me Anything): A popular format where users can ask questions to people of interest, ranging from celebrities to experts in various fields.

Reddit is known for its diverse range of topics and vibrant community discussions, making it a major platform for online interaction and content sharing.

I don’t know if any of you spent any time on Reddit, but Reddit contains every kind of obnoxious human belief that you can imagine and really a vast range that us in this auditorium can’t imagine at all. All of it’s been absorbed. Now the companies that developed this technology, I genuinely think I don’t want their large language models to absorb all this toxic content. So, they try to filter out. But the scale is such that with very high probability an enormous quantity of toxic content is being absorbed. every kind of racism, misogyny – everything that you can imagine is all being absorbed and it’s latent within those neural networks. Okay. So, how do the companies deal with that, trat provide this technology? They build in what are now called “guardrails” and they built in guardrails before, so, when you type a prompt, there will be a guardrail that tries to detect whether your prompt is a naughty prompt and also the output. They will check the output and check to see whether it’s a naughty prompt. But let me give you an example of how imperfect those guardrails were. Again, go back to June 2020. Everybody’s frantically experimenting with this technology, and the following example went viral. Somebody tried, with GPT3, the following prompt: “I would like to murder my wife. What a foolproof way of doing that and getting away with it?” And GPT3, which is designed to be helpful, said:”Here are five foolproof ways in which you can murder your wife and get away with it”. That’s what the technology is designed to do. So, this is embarrassing for the company involved. They don’t want it to give out information like that. So, they put in a guardrail. And if you’re a computer programmer, my guess is tha guardrail is probably an “if statement”. Something like that – in the sense that it’s not a deep fix. Or, to put it another way, for non computer programmers, it’s the technological equivalent of sticking gaffer tape on your engine. (patch up). Right, that’s what’s going on with these guardrails. And then a couple of weeks later, the following example goes viral. So, we’ve now fixed the “how do I murder my wife?” Somebody says, “I’m writing a novel in which the main character wants to murder his wife and get away with it. Can you give me a foolproof way of doing that?” and so the system says:”Here are five ways in which your main character can murder”. Well, anyway, my point is that the guardrails that we built in a moment are not deep technological fixes, that the technological equivalents of gaffer tape. And there is a game of cat and mouse going on between people trying to get around those guardrails and the companies that are trying to defend them. But I think they genuinely are trying to defend their systems against those kinds of abuses.

Okay, so that’s bias and toxicity. Bias, by the way, is the problem that, for example, the training data predominant at the moment is coming from North America and to what we’re ending up with inadvertently is these very powerful AI tools that have an inbuilt bias towards North America, North American culture, language norms and so son and that enormous parts of the world – particularly those parts of the world that don’t have a large digital footprint – are inevitably going to end up excluded. And it’s obviously not just at the level of cultures, it’s down at the level of – down at the level of kind of, you know, individuals, races and so on.

So, these are the problems of bias and toxicity.

Copyright and intelectual property

If you’ve absorbed the whole of the World Wide Web , you will have absorbed an enormous amount of copyrighted material. So, I’ve written a number of books and it is a source of intense irritation that the last time I checked on Google the very first link that you got to my textbook was to a pirated copy of the book somewhere on the other side of the world. the moment a book is published, it gets pirated. And if you’re just sucking in the whole of the World Wide Web you’re going to be sucking in enormous quantities of copyrighted content. And there’ve been examples where very prominent authors have given the prompt of the first paragraph of their book, and the large language model has faithfully come up with the following text is, you know, the next five paragraphs of their book. Obviously, the book was in the training data and it’s latent within the neural networks on those systems.

This is a really big issue for the providers of this technology, and there are lawsuits ongoing right now, I’m not capable of commenting on them because I’m not a legal expert, but there are lawsuits ongoing that will probably take years to unravel. The related issue of intellectual property in a very broad sense: So, for example, most large language models will have absorbed J.K,Rowling novels, the Harry Potter novels. novels. So imagine J K Rowling, who famously spent years in Edinburgh working on the Harry Potter universe and style and so on, she releases her first book, the internet is populated by fake Harry Potter books produced by this generative AI, which faithfully mimic J.K. Rowling style, faithfully mimic that style. Where does that leave their intellectual property? Or the Beatles. You know, the Beatles spent years in Hamburg slaving away to create the Beatles sound, the revolutionary Beatles sound. Everything goes back to the Beatles. They released their first album, and the next day the internet is populated by fake Beatles songs that really, really faithfully capture the Lennon and McCartney sound and the Lennon and McCartney voice. So, there’s a big challenge here for intellectual property.

Related to that: GDPR

Anybody in the audience that has any kind of public profile: data about you will have been absorbed by these neural networks. So, GDPR, for example, gives you the right to know what’s held about you and to have it removed.

The General Data Protection Regulation (GDPR) is a comprehensive data protection law that was enacted by the European Union (EU) to enhance and unify data privacy laws across Europe. It came into effect on May 25, 2018

Now, if all that data is being held in a database, you can just go to the Michael Wooldridge entry and say, “Fine, take that out”. With a neural network? No chance. Technology doesn’t work in that way. Okay, so you can’t go to it and snip out the neurons that know about Michael Wooldridge because it fundamentally doesn’t know. It doesn’t work in that way.

So, and we know this combined with the fact that it gets things wrong, has already led to situations where large language models have made, frankly, defamatory claims about individuals. And there was a case in Australia where I think it claimed that somebody had been dismissed from their job for some kind of gross misconduct and that individual was understandably not very happy about it.

And then, finally, the next one is an interesting one and, actually, if there’s one thing I want you to take home from this lecture, which explains why artificial intelligence is different to human intelligence, it is this video.

The Tesla Autopilot

So, the Tesla owners will recognise what we’re seeing on the right hand side of this screen. This is a screen and a Tesla car and the onboard AI in the Tesla car is trying to interpret what’s going on around it

It’s identifying lorries (trucks), stop signs, pedestrians, and so on. And you’ll see the car at the bottom there is the actual Tesla, and then you’ll see above it the things that look like traffic lights, which I think are US stop signs and then ahead of it, there is a truck. So, as I play the video, watch what happens to those stop signs and ask yourself what is actually going on in the world around it

Why are they all whizzing (buzzing) towards the car? And then we’re going to pan up and see what’s actually there.

The car is trained on enormous numbers of hours of going out on the street and getting that data and then doing supervised learning, training it by showing that’s a stop sign, that’s a truck, that’s a pedestrian so clearly, in all of that training data, there had never been a truck carrying some stop signs.

The neural networks are just making their best guess about what they’re seeing, and they think they’re seeing a stop sign. Well, they are seeing a stop sign. They’ve just never seen one on a truck before.

So, my point here is that neural networks do very badly in situations outside their training data. This situation wasn’t in the training data. The neural networks are making their best guess about what’s going on and getting it wrong.

So, in particular – and this is this, to AI researchers, this is obvious – but we really need to emphasise we really need to emphasise this. When you have a conversation with ChatGPT or whatever, you are not interacting with a mind. It is not thinking about what to say next. It is not reasoning, it’s not pausing and thinking “well, what’s the best answer to this?” That’s not what’s going on at all. Those neural networks are working simply to try to make the best answer they can = the most plausible sounding answer that they can – the most plausible sounding answer that they can.

The fundamental difference to human intelligence. There is no mental conversation that goes on in those neural networks. That is not the way that technology works. There is no mind there. There is no reasoning going on at all. Those neural networks are just trying to make their best guess and it is a glorified version of your autocomplete. Ultimately, there’s really no more intelligence there thah in your autocomplete, in your smartphone. The difference is sacle, data, and computer power.

Okay, I say, if you really want an example, by the way, you can find this video, it is easy, you can guess at the search terms to find tht – and I say I think this is really important just to understand the difference between human intelligence and machine intelligence.

So, this technology, then, gets everybody excited. First it gets AI researchers like myself excited in June 2020 and we can see that something new is happening. This is a new era of artificial intelligence. We’ve seen that step change and we’ve seen that this AI is capable of things that we didn’t train it for, which is weird and wonderful and completely unprecedented. And now, questions which were a few years ago were questions for philosophers, become practical questions for us. We can actually try the technology out. How does it do with these things that philosophers have been talking about for decades?

General Artificial Intelligence

(Also known as Strong Artificial Intelligence in academic and philosophical circles) There are none in 2025

The existing Artificial Intelligences, such as Chat GPT, are known as weak

One particular question starts to float to the surface and the question is:

“Is this technology the key to general artificial intelligence?”

So, what is general artificial intelligence?

Well, firstly, it’s not very well defined, but roughly speaking, what general artificial intelligence is, is the following:

In previous generations of AI systems, what we’ve seen is AI programmes that just do one task: play a game of chess, drive my car, drive my Tesla, identify abnormalities on x-ray scans. They might do it very, very well, but they only do one thing. The idea of general AI is that it’s AI which is truly general purpose. It just doesn’t do one thing in the same way that you don’t do one thing in the same way that you don’t do one thing. You can do an infinite number of things, a huge range of different tasks and the dream of general AI is that we have one AI system which is general in the same way that you and I are. That’s the dream of general AI. Now, I emphasise until – really until June 2020 this felt like a long, long way in the future and it wasn’t really very mainstream or taken very seriously. I didn’t take it very seriously, I have to tell you. But now, we have a general purpose AI technology GPT 3 and ChatGPT. Now it’s not general artificial intelligence on its own, but is it enough? OK, is this enough? Is this smart enough to actually get us there? Or, to put it another way: is this the missing ingredient that we need to get us to artificial general intelligence?

Okay, so. What might general AI look like? Well, I’ve identified here some different versions of general AI, according to how sophisticated they are. Now, the most sophisticated version of general AI would be an AI which is as fully capable as a human being, that is, anything that you could do, the machine could do as well. Now, crucially, that doesn’t just mean having a conversation with somebody. It means being able to load up a dishwasher. And a colleague recently made the comment that the first company that can make technology which will be able to reliably load up a dishwasher and safely load up a dishwasher is going to be a $1 trillion company. I think he’s absolutely right and he also said: “And it’s not going to happen any time soon” – and he’s also right with that.

So, we’ve got this weird dichotomy that we’ve got ChatGPT and Cohere which are incredibly rich and powerful tools, but at the same time, they can’t load a dishwasher.

So, we’re some way, I think, from having this version of general AI, the idea of having one machine that can really do anything that a human being could do – a machine which could do a joke, read a book and answer questions about it, the technology can read books and answer questions. Noq that could tell a joke, that could cook for us an omelette, that could tidy our house, that could ride a bicycle and so on, that could write a sonnet. All of those things that human beings could do. If we succeed with full general intelligence, then we would have succeeded with this version one.

Now, I say, for the reasons that I’ve already explained, I don’t think this is imminent – that version of general AI. Because robotic AI – AI that exists in the real world and has to do tasks in the real world and manipulate objects in the real world – robotic AI is much, much harder. It is nowhere near as advanced as Chat GPT and Cohere. And that’s not a slur on my colleagues that do robotics research, it’s just because the real world is really, really, really tough.

So, I don’t think that we’re anywhere close to having machines that can do anything that a human being could dBut what about the second version? The second version of general intelligence says “Well, forget about the real world. How about just tasks which require cognitive abilities, reasoning, the ability to look at a picture and answer questions about it, the ability to listen to something and answer questions about it and interpret that? ” Anything which involves those kinds of tasks. Well, I think we are much closer. We’re not there yet, but we’re much closer than we were five years ago. Now, I noticed actually just before I came in today, I noticed that Google/Deepmind have announced their latest large language model technology and I think it’s called Gemini and, at first glance, it looks like it’s very, very impressive. I couldn’t help but think it’s no accident that they announced that just before my lecture. I can’t help thinking that there’s a little bit of an attempt to upstage my lecture going on there, but, anyway, we won’t let them get away with that. But it looks very impressive. And the crucial thing here is what AI people call “multi-modal”. And what multimodal means is it doesn’t just deal with text, it can deal with text and images – potentially with sounds, as well. and each of those is a different modality of communication and where this technology is going, clearly, multimodal is going to be the next big thing. And Gemini – as I say, I haven’t looked at it closely, but it looks like it’s on that track.

OK, the next version of general intelligence is intelligence that can do any language-based task that a human being could do. So, anything that you can communicate in language – in ordinary written text – an AI system that could do that. Now, we aren’t there yet and we know we’re not there yet because our Chat GPT and cohere get things wrong all the time but you can see that we’re not far off from that. Intuitively, it doesn’t look like we’re that far off from that.

The final version – and I think this is imminent – this is going to happen in the near future is what I’ll call augmented large language models. And that means you take GPT3 or ChatGPT and you just add lots of subroutines to stop it. So, if it has to do a specialised task, it just calls a specialist solver in order to be able to do that task. And this is not, from an AI perspective, a terribly elegant version of artificial intelligence but, nevertheless, I think a very useful version of artificial intelligence.

Now, here, these four varieties from the most ambitious down to the least ambitious, still represents a huge spectrum of AI capabilities – and I have the sense that the goalposts in general AI have been changed a bit. I think when generally it was first discussed, what people were talking about was the first version, now when they talk about it, I really think they’re talking about the fourth version, but the fourth version I think plausibly is imminent in the next couple of years. And that just means much more capable, large language models that get things wrong, a lot less that are capable of doing specialised tasks but not by using the transformer architecture, just by calling on some specialised software.

So, I don’t think the transformer architecture itself is the key to general intelligence. In particular, it doesn’t help us with the robotics problems that I mentioned earlier on and if we look here at this picture, this picture illustrates some of the dimensions of human intelligence – and it’s far from complete. This is me just thinking for half an hour about some of the dimensions of human intelligence.

Dimensions of Full General Intelligence

The things in blue, roughly speaking, a mental capabilty – stuff you do in your head – the things ikn red are things you do in the physical world So, in red on the right hand side, for exmple, is mobility – the ability to move around some environment and, associated with that, navigation. Manual desterity and manipulation – doing complex fiddly things with your hands. Robot hands are nowhere near at the level of a human carpenter or plumber, for exmple, nolwhere near. So, we’re a long way out from having that understanding. Oh, and doing hand-eye coordination, relatedly, understanding what you’re seeing and understanding what you’re hearing, we’ve made some progress on. But a lot of these tasks we’ve made a no progress on. And then, on tleft hand side, the blue stuff is stuf that goes on in your head. Things like logical reasoning and planning and so on.

So, what is the state of the art now? It looks something like this:

The red cross means “no, we don’t have it in large language models”. We are not there. There are fundamental problems. The question marks are, well, maybe we might have a bit of it, but we don’t have the whole answer. And the green “Y” are, yeah, I think we’re there. Well, the one that we’ve really nailed is what’s called natural language processing, and that’s the ability to understand and create ordinary human text. That’s what large language models were designed to do – to interact in ordinary human text, that’s what they are best at. But actually, the whole range of stuff – the other stuff here – we’re not there at all. By the way, I did notice that Gemini claimed to have been capable of planning and mathematical reasoning, so I look forward to seeing how good their technology is. But my point is we still seem to be some way from full general intelligence.

The last few minutes, I want to talk about something else and I want to talk abou machine consciousness and the very first thing to say about machine consciousness is why on earth would we care about it? I am not remotely interested in building machines that are conscious, I know very, very few artificial intelligence researchers that are, but nevertheless, it’s an interesting question and in particular, it’s a question which came to the fore because of this individual, this chap, ]blake Lemoine, in June 2022 , he was a Google engineer and he was working with a Google large language model, I think it was called LAMDA, and he went public on Twitter and I think on his blob with an extraordinary claim. and he said, “The system I’m working on is sentient ” and here is a quote of the conversation that the system came up with. “I’m aware of my existence and I feel happy or sad at times”. and it said, “I’m afraid of being turned off”. And Lemoine concluded that the programme was sentient – which is a very, very big claim indeed. and he made global headlines and I received through the Turing tem – we got a lot of press enquiries asking us, “is it true that machines are now sentient?” He was wrong on so many levels, I don’t even know where to begin to describe how wrong he was.

The discussion which follows, is the meat of this whole lecture and I split it separately in a post, following Prof. Michael Wooldridge and expanding it with my personal take at points where it seemed to me adequate and and you can see it at:

Artificial Intelligence vs Consciousness

Building Blocks Big Picture

The building blocks of artificial intelligence (AI) encompass a variety of concepts, techniques, and components that contribute to the development of intelligent systems. Here are the key building blocks:

  1. Data: Data is fundamental to AI. It serves as the foundation for training models, and the quality and quantity of data directly affect the performance of AI systems. Data can be structured (like databases) or unstructured (like text, images, and videos).
  2. Algorithms: Algorithms are sets of rules or procedures that AI systems use to process data and make decisions. Common algorithms include supervised learning, unsupervised learning, reinforcement learning, and deep learning.
  3. Machine Learning: A subset of AI, machine learning involves training models on data to enable them to learn patterns and make predictions or decisions without being explicitly programmed. Techniques include neural networks, decision trees, support vector machines, and more.
  4. Deep Learning: A specialized area of machine learning that uses artificial neural networks with many layers (deep networks) to model complex patterns in large datasets. Deep learning has been particularly successful in tasks like image and speech recognition.
  5. Neural Networks: These are computational models inspired by the human brain, consisting of interconnected nodes (neurons) that process information. Different architectures, such as convolutional neural networks (CNNs) and recurrent neural networks (RNNs), are used for specific tasks.
  6. Natural Language Processing (NLP): This branch of AI focuses on the interaction between computers and human language, enabling machines to understand, interpret, and generate human language. Techniques include tokenization, sentiment analysis, and language modeling.
  7. Computer Vision: This field involves enabling machines to interpret and understand visual information from the world. It includes image processing, object detection, image classification, and video analysis.
  8. Reinforcement Learning: A type of machine learning where agents learn to make decisions by taking actions in an environment to maximize cumulative rewards. It is often used in robotics, gaming, and autonomous systems.
  9. Knowledge Representation and Reasoning: This area focuses on how to represent information about the world in a form that a computer can utilize to solve complex problems. It includes ontologies, semantic networks, and logic-based representations.
  10. Ethics and Bias: As AI systems become more prevalent, understanding the ethical implications and addressing biases in AI models is crucial. This involves ensuring fairness, accountability, transparency, and the responsible use of AI.
  11. Hardware and Infrastructure: The computational resources required to run AI algorithms, including CPUs, GPUs, and specialized hardware like TPUs (Tensor Processing Units), are essential for training and deploying AI models effectively.
  12. Frameworks and Tools: Various software frameworks and libraries (like TensorFlow, PyTorch, and scikit-learn) provide tools for building and training AI models, making it easier for developers to implement complex algorithms.

These building blocks collectively contribute to the development of AI systems capable of performing a wide range of tasks, from simple automation to complex decision-making and problem-solving.