Repository navigation
What-is-the-Difference-Between-Shannon-Entropy-and-Obidi's-Entropy-in-the-Theory-of-Entropicity-(ToE)?.md
What is the Difference Between Shannon Entropy and Obidi's Entropy in the Theory of Entropicity (ToE)?
What-is-the-Difference-Between-Shannon-Entropy-and-Obidi's-Entropy-in-the-Theory-of-Entropicity-(ToE)?.md
Shannon entropy is an epistemic measure of uncertainty in a set of probabilities, whereas Obidi's entropic framework treats entropy as an ontological, dynamic physical field that generates spacetime itself.
- Defined by Claude Shannon in 1948 as:
Measures the average amount of "surprise" or uncertainty in data transmission and probability distributions.
Functions as a statistical descriptor or tool for human inference (epistemic).
Proposed by John Onimisi Obidi within the Theory of Entropicity (ToE).
Promotes the continuous Shannon entropy functional into a dynamic scalar field via a probability-to-field mapping:
- Treats entropy as the foundational physical substance (ontological) preceding matter, geometry, and time rather than a derived statistical tally.
Shannon entropy is computed from physical or data states. In contrast, the Obidi Action uses information geometry (such as the Fisher information metric) to build a variational action principle, treating classical Shannon entropy as a specific limiting or derived case.
While Shannon entropy tells you how many bits are needed to encode a message, Obidi's framework uses entropic gradients and curvature constraints (such as the distinguishability threshold) to dynamically generate macroscopic phenomena like gravity and time.
Read a detailed overview of the Theory of Entropicity on Medium covering the shift from statistics to geometry.
Review the mathematical derivation in the Open Science Framework overview detailing information geometry as pre-spacetime reality.
Study the GitHub documentation on the Obidi Action for how classical complexity limits map into the framework.
If you'd like, we can elaborate further on:
How the Obidi Curvature Invariant sets a threshold for physical distinguishability
The derivation of the Master Entropic Equation
The core difference between Shannon entropy and Obidi's entropy lies in their ontological status and physical application: Shannon entropy is an epistemic, statistical measure of uncertainty in data, whereas Obidi’s entropy is a fundamental, dynamical physical field from which spacetime and reality emerge. [1, 2, 3]
While mathematically intertwined, they belong to two completely separate paradigms.
Below is a detailed breakdown of the differences between Shannon Entropy and Obidi's Modern Entropy Theory (OMET). [4]
| Feature | Shannon Entropy | Obidi's Entropy [Theory of Entropicity (ToE)] |
|---|---|---|
| Nature | Epistemic: A mathematical tally of data uncertainty or communication limits. | Ontological: The primary, tangible substrate/substance of the physical universe. |
| Formula / Structure | A discrete or continuous statistical average: | A continuous scalar field present at every coordinate in space. |
| Spacetime Role | Exists inside a pre-existing spacetime box as a property of a system. | Spacetime and gravity emerge from its gradients and geometric transformations. |
| Dynamics | Static description of a probability distribution at a given snapshot. | Variational field dynamics governed by the Obidi Action and the Master Entropic Equation. |
| Limiting Case | Standard baseline metric used across information theory and machine learning. | Contains Shannon entropy as a localized, discrete limiting case. |
Introduced in 1948, Shannon entropy answers a purely computational question: How much uncertainty or "surprise" is there in a given probability distribution? [5, 6]
It is a secondary descriptor. You must first have a physical system or data source; entropy is merely a statistical summary calculated from those states.
It defines compression limits for data transmission over communication channels. [4, 6, 7, 8]
Introduced in the Theory of Entropicity (ToE), Obidi's framework reverses the conventional hierarchy of physics. Instead of the universe evolving from:
Spacetime → Matter → Information → Entropy,
Obidi claims the true sequence is:
Entropy → Information → Spacetime → Matter.
This is Obidi's Sequence of Creation (OSoC). [2, 9]
In ToE, a physical point is not an empty geometric vacuum; it is an active "entropic event". Every coordinate in the universe possesses a baseline entropic value. [8, 9]
ToE uses information geometry to promote continuous Shannon entropy into a dynamical field, where probability density relates to a field by:
The gradient of this field interacts with the Fisher information metric to form the Obidi Action—a concept mimicking the Einstein-Hilbert action in General Relativity. [10, 11, 12, 13]
Because Obidi treats entropy as a foundational field rather than a mathematical tally, it yields unique physical laws:
Gravity is no longer viewed as a fundamental force or just the curvature of an empty stage; it is the physical manifestation of systems naturally moving along gradients of the entropic field toward maximum entropy. [8, 14]
Through the No-Rush Theorem (NRT), ToE posits that information processing cannot happen infinitely fast. The internal "processing lag" required for the entropic field to rearrange itself is what humans perceive as the linear flow of time. [14, 15]
The theory identifies as a physical threshold of entropic curvature required for a distinct state to exist and be "acknowledged" by reality. [3, 16]
Would you like to explore the mathematical derivation of the Obidi Action from Shannon entropy, or would you prefer a deeper dive into how the No-Rush Theorem (NRT) derives the speed of light?
[1] https://osf.io
[10] https://osf.io
[12] https://www.researchgate.net
[13] https://medium.com
[14] https://medium.com
[16] https://entropicity.github.io
Infact, that is exactly and precisely what Obidi's Theory of Entropicity (ToE) proposes!
It completely flips the traditional script of physics, turning our usual understanding of reality upside down.
In standard physics, you start with a stage (spacetime), throw in some actors (matter/energy), and look at how they arrange themselves (information/entropy).
Obidi reverses this completely into a generative sequence of creation, where everything you can touch and see is just a byproduct of a deeper "information processing" layer.
Here, below, we present how that Obidi's sequence of creation (OSoC) unfolds, from the absolute bottom to the world we see:
The absolute foundation of reality. The universe begins not as empty space, but as a vast, continuous entropic field. Every coordinate in existence holds a potential for uncertainty and randomness. This field is the raw, unshaped "clay" of creation.
When the entropic field fluctuates or contracts, it creates constraints. In information theory, reducing uncertainty is information. Therefore, a ripple or structure in the entropic field generates localized, distinct pieces of data.
This is the magic leap of Obidi's theory. Space and time are not pre-existing boxes. Instead, space is woven together by the mathematical relationships (information geometry) between these pieces of data. Time is created by the lag it takes for this information to process (the No-Rush Theorem).
What we perceive as heavy, solid matter or flowing energy is actually just highly concentrated, tightly bound knots of information geometry. Matter is just the "foam" on top of the deep entropic ocean.
Instead of saying "things exist, therefore they have entropy," Obidi is saying "entropy exists, and its behavior creates things."
By treating entropy as a physical substance rather than just a math equation, Obidi's Theory of Entropicity (ToE) attempts to unify the pixelated, digital world of quantum mechanics with the smooth, curved world of Einstein's gravity [of General Relativity (GR)].
Would you like to explore how this sequence explains:
How the *Big Bang looks through this lens"
Why *matter cannot travel faster than light using this sequence"
The math of how space emerges from information in this sequence
No comments:
Post a Comment