Data Mesh Quotes

(...) The floor itself was inscribed with a mosaic in the data-pattern mode, representing the entire body of the Curia case law. At the center, small icons representing constitutional principles sent out lines to each case in which they were quoted; bright lines for controlling precedent, dim lines for dissenting opinions or dicta. Each case quoted in a later case sent out additional lines, till the concentric circles of floor-icons were meshed in a complex network. The jest of the architect was clear to Phaethon. The floor mosaic was meant to represent the fixed immutability of the law; but the play of light from the pool above made it seem to ripple and sway and change with each little breeze. Above the floor, not touching it, without sound or motion, hovered three massive cubes of black material. These cubes were the manifestations of the Judges. The cube shape symbolized the solidity and implacable majesty of the law. Their high position showed they were above emotionalism or earthly appeals. The crown of each cube bore a thick-armed double helix of heavy gold. The gold spirals atop the black cubes were symbols of life, motion, and energy. Perhaps they represented the active intellects of the Curia. Or perhaps they represented that life and civilization rested on the solid foundations of the law. If so, this was another jest of the architect. The law, it seemed, rested on nothing.

How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh”,

The insatiable need for more processing power -- ideally, located as close as possible to the user but, at the very least, in nearby indus­trial server farms -- invariably leads to a third option: decentralized computing. With so many powerful and often inactive devices in the homes and hands of consumers, near other homes and hands, it feels inevitable that we'd develop systems to share in their mostly idle pro­cessing power. "Culturally, at least, the idea of collectively shared but privately owned infrastructure is already well understood. Anyone who installs solar panels at their home can sell excess power to their local grid (and, indirectly, to their neighbor). Elon Musk touts a future in which your Tesla earns you rent as a self-driving car when you're not using it yourself -- better than just being parked in your garage for 99% of its life. "As early as the 1990s programs emerged for distributed computing using everyday consumer hardware. One of the most famous exam­ples is the University of California, Berkeley's SETl@HOME, wherein consumers would volunteer use of their home computers to power the search for alien life. Sweeney has highlighted that one of the items on his 'to-do list' for the first-person shooter Unreal Tournament 1, which shipped in 1998, was 'to enable game servers to talk to each other so we can just have an unbounded number of players in a single game session.' Nearly 20 years later, however, Sweeney admitted that goal 'seems to still be on our wish list.' "Although the technology to split GPUs and share non-data cen­ter CPUs is nascent, some believe that blockchains provide both the technological mechanism for decentralized computing as well as its economic model. The idea is that owners of underutilized CPUs and GPUs would be 'paid' in some cryptocurrency for the use of their processing capabilities. There might even be a live auction for access to these resources, either those with 'jobs' bidding for access or those with capacity bidding on jobs. "Could such a marketplace provide some of the massive amounts of processing capacity that will be required by the Metaverse? Imagine, as you navigate immersive spaces, your account continuously bidding out the necessary computing tasks to mobile devices held but unused by people near you, perhaps people walking down the street next to you, to render or animate the experiences you encounter. Later, when you’re not using your own devices, you would be earning tokens as they return the favor. Proponents of this crypto-exchange concept see it as an inevitable feature of all future microchips. Every computer, no matter how small, would be designed to be auctioning off any spare cycles at all times. Billions of dynamically arrayed processors will power the deep compute cycles of event the largest industrial customers and provide the ultimate and infinite computing mesh that enables the Metaverse.

How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh [without me showing you how].

the effect of the observer on the quantum field causes reality to reorganize according to the observation. This means that a newly observed reality descends through the frequency levels below the quantum, becoming dense in material reality.23 The nonobserved information becomes “lost” if it doesn’t qualify as “real” or desirable to the observer. It is not eliminated; instead, the not-selected potential slips into a pocket of “elsewhere.” Conceivably, we can get it back. As Lloyd explains, we can access lost data by “flipping a qubit,” a code phrase that means we can apply a magnetic field to force energy to shift from one state to another.24 We have established that the subtle layer is atop the physical and that the etheric layer of subtle energies is magnetic in nature. Could it be that the information we cannot find—perhaps, the data that could make a sick person well—is lingering a plane above us? We’ve one more law to face: the third law of thermodynamics. Experiments with absolute zero provide a new perspective on it, one that coaxes an understanding of subtle energy. Absolute zero is the point at which particles have minimum energy, called zero-point energy. Researchers including Dr. Hal Puthoff have identified this zero-point energy with zero-point field, a mesh of light that encompasses all of reality. (This field is further explained in Part III.) This field of light is a vacuum state, but it is not empty; rather, it is a sea of electromagnetic energy, and possibly, virtual particles—ideas that can become real. Conceivably, energy should stand completely still at absolute zero, which would mean that information would become permanently imprisoned. Research on zero-point energy, however, reveals that nearing zero-point, atomic motion stops, but energy continues. This means that “lost information” is not really lost. Even when frozen, it continues to “vibrate” in the background. The pertinent questions are these: How do we “read” this background information? How do we apply it? These queries are similar to those we might ask about “hidden” information. How do we access suppressed but desirable data? The answers lie in learning about subtle structures, for these dwell at the interfaces between the concrete and the higher planes. Operate within the subtle structures, and you can shift a negative reality to a positive one, without losing energy in the process.

MIT physicist Seth Lloyd supports the idea of other worldly portals in his book Programming the Universe. Quantum mechanics has proven that an electron is not only allowed to be in two places at once—it is required to be. Certain particles not only spin in two directions at the same time, but have to do so.21 At really high speeds, atoms require more information to describe their movements, and therefore they have more entropy.22 However, an observer affects the outcome of whatever he or she is observing. As explained in the book The Orb Project, the effect of the observer on the quantum field causes reality to reorganize according to the observation. This means that a newly observed reality descends through the frequency levels below the quantum, becoming dense in material reality.23 The nonobserved information becomes “lost” if it doesn’t qualify as “real” or desirable to the observer. It is not eliminated; instead, the not-selected potential slips into a pocket of “elsewhere.” Conceivably, we can get it back. As Lloyd explains, we can access lost data by “flipping a qubit,” a code phrase that means we can apply a magnetic field to force energy to shift from one state to another.24 We have established that the subtle layer is atop the physical and that the etheric layer of subtle energies is magnetic in nature. Could it be that the information we cannot find—perhaps, the data that could make a sick person well—is lingering a plane above us? We’ve one more law to face: the third law of thermodynamics. Experiments with absolute zero provide a new perspective on it, one that coaxes an understanding of subtle energy. Absolute zero is the point at which particles have minimum energy, called zero-point energy. Researchers including Dr. Hal Puthoff have identified this zero-point energy with zero-point field, a mesh of light that encompasses all of reality. (This field is further explained in Part III.) This field of light is a vacuum state, but it is not empty; rather, it is a sea of electromagnetic energy, and possibly, virtual particles—ideas that can become real. Conceivably, energy should stand completely still at absolute zero, which would mean that information would become permanently imprisoned. Research on zero-point energy, however, reveals that nearing zero-point, atomic motion stops, but energy continues. This means that “lost information” is not really lost. Even when frozen, it continues to “vibrate” in the background. The pertinent questions are these: How do we “read” this background information? How do we apply it? These queries are similar to those we might ask about “hidden” information. How do we access suppressed but desirable data? The answers lie in learning about subtle structures, for these dwell at the interfaces between the concrete and the higher planes. Operate within the subtle structures, and you can shift a negative reality to a positive one, without losing energy in the process.

What I like to add to this description is the outcome. The domain has a specific business objective and an outcome it is optimizing for.

There is a culture that obsessively runs experiments, observes the results, analyzes the data, makes sense of it, learns from it, and adapts.

if the goal of the system becomes “the number of data products,” early in the development of the mesh, this leverage point results in a focus on generating data, and not necessarily generating value from the data.

As Fred Brooks laid out in his widely popular paper, “No Silver Bullet—Essence and Accident in Software Engineering”, there are two types of complexity when building software systems. First, we have the essential complexity that is essential and inherent to the problem space. This is business and domain complexity. Second, there is accidental complexity: the complexity that we—engineers, architects, and designers—create in our solutions. Accidental complexity can and should be reduced.

Despite the relentless effort to remove coordination and synchronization in core technologies, we have, for the most part, neglected organizational and architectural coordination. As a result, no matter how fast our computer systems run, achieving outcomes have fallen behind coordinating activities of teams and humans.

Data product owners are the long-term owners of the domains’ data products. They intrinsically care about the longevity and success of their data product as a member of the mesh. They have accountability for the security, quality, and integrity of their data. Given the guiding principle of executing decisions locally, the data product owners are ultimately accountable for making sure the global governance decisions are executed at the level of every single data product. Early buy-in and contribution of domains to define the global policies is crucial in adoption of them.