Variety and organization (long post is...)
Feb. 2nd, 2011 06:49 pm![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
davvElsewhere, I referred to how useful I've found variety in explaining why organizations behave the way they do. In particular, I thought a bit about why nations with large states tend to encourage the people to be uniform, through a sort of "equality by uniformity". And then I thought about variety, and just by turning the problem around, looking at it from the right angle, it became simple... and it should show what it is I mean.
To make sense, I'll have to show what I mean by "variety". Variety is the number of possible states of a system. A ball resting on a table has only one state, where it is resting on the table. A heater may have more than one state: it can be on, off, or somewhere in between. If the only choices are full blast or nothing at all, then it has a variety of 2.
I also have to show what is meant by control, in the technical sense. A controller or regulator limits the variety of the system it is controlling. A room without a thermostat-controlled heater has a wide range of possible temperatures (depending on the temperature outside), but one where the temperature is being regulated has a much more narrow range.
The controller does this by observing and adjusting towards the desired outcome, then observing again, adjusting further, and so on. This is feedback.
So, how does that relate to organizations and governments? There's one more thing to know: in order to control a system, the controller must have at least as much variety as the system[1]. For every move that may take the system out of the desired state, the controller has to have some way of pushing the system back into the desired state. If the controller does not, it will only partially control the system, or fail entirely. That is requisite variety: "variety absorbs variety", or "only variety in R can force down variety in D".
If we take the traditional ideologies of left and right at their face value, then it appears that the distinction, when taken to the extreme is as follows:
The "regulator" in this case is usually the state. However, the state is organized in a bureaucratic manner, which means it has low variety. Unless the state is a police state, it is limited in what actions it can take, and even for those actions it can take, the inefficiency of the bureaucracy means that the "countermove" is only partially successful in limiting the variety of, say, the economy.
Since the state has low variety, the ideologies above are polar. If the regulator is to permit a high variety in society, it must accept a weakening of its ability to regulate or control. On the other hand, if the regulator is to be successful at what it aims to do, which is to limit unfortunate outcomes, it must somehow manage to have society lower its own variety because the state cannot directly handle its task otherwise - it simply does not have the capacity to do so.
Out of that observation, the tendency of left-leaning central governments to desire uniformity becomes easy to see. The state cannot directly control the parameters it wants (economic ones, for instance), and so will promote what I call a type-2/type-3 or majoritarian concept of equality: that everybody is equal if they're uniform. If the people accepts it, that would greatly reduce the variety of society, potentially bringing control within the grasp of the state[2].
One would also assume, based on the above, that right-leaning governments would forgo regulation altogether. That is certainly a goal of its extreme position, but "right" seldom goes as far as to advocate a free-for-all anarchy, for that would destroy freedom. Even the right wants some regulation, and practically speaking, the economic powers (corporations and private organizations) that tend to benefit from a right position will advocate that they, rather than the state, perform the task of a controller, but for their own purposes.
Even though I didn't specifically intend to reach the conclusion when I first wrote this (in a text file of my own), it's surprising how easily the conclusion follows: if the state doesn't have enough variety to regulate well - which it doesn't, being bureaucratic - it will encourage the system to become more well-behaved so it can.
As for me, I think that if left to its own, the system, at least the economic part of it, is unstable. If there is minimal economic regulation, some entity (a company, most likely) will eventually gain enough power to rewrite the rules. At that point, it can decide to be the new state, and the control it then exercises will not be for the good of the people. Pretty much the same thing applies in the absence of any order at all, except the entities are not only economic, they make use of physical force as well. The different mafia gangs will compete until someone ends up on top, at which point the game is over.
The alternative, though, is not very good either. It is better than being in a cyberpunk future, but if the state cannot regulate directly, it will keep trying to simplify the people so that they can be regulated. What is the answer? I think, and this is my opinion, of course, that the regulator must be set up so that it has the requisite variety - not by making the state a police state, but by design of the organization, decentralization, and so on. A recursive design would help, but it must not become too bogged down in sending messages up and down a hierarchy. With the power granted by the high variety in the regulator, the regulator itself (the "state", or more broadly, the group of organizations handling governing functions) has to be anchored by the wishes of the people. Ideally, it should be radically transparent, free of hierarchy, and incorporate ordinary people so that it will resist corruption for as long as possible.
[1] Generally, it must have as much variety as it's trying to reduce in the system being regulated. A bang-bang (on-off) thermostat can limit temperature in a room to a certain range by using some variety, but a PID controller can make use of the heater's ability to be set at other levels than full blast and nothing at all to regulate to a much tighter range.
[2] The more centralized the state, the more variety it has to deal with, and the greater this effect would be. The effect is the same thing that makes micromanagement so impractical. If a center tries to coordinate everything, even if that center is somehow perfectly honest and not corrupted by power, it soon finds itself overextended and quality suffers.
To make sense, I'll have to show what I mean by "variety". Variety is the number of possible states of a system. A ball resting on a table has only one state, where it is resting on the table. A heater may have more than one state: it can be on, off, or somewhere in between. If the only choices are full blast or nothing at all, then it has a variety of 2.
I also have to show what is meant by control, in the technical sense. A controller or regulator limits the variety of the system it is controlling. A room without a thermostat-controlled heater has a wide range of possible temperatures (depending on the temperature outside), but one where the temperature is being regulated has a much more narrow range.
The controller does this by observing and adjusting towards the desired outcome, then observing again, adjusting further, and so on. This is feedback.
So, how does that relate to organizations and governments? There's one more thing to know: in order to control a system, the controller must have at least as much variety as the system[1]. For every move that may take the system out of the desired state, the controller has to have some way of pushing the system back into the desired state. If the controller does not, it will only partially control the system, or fail entirely. That is requisite variety: "variety absorbs variety", or "only variety in R can force down variety in D".
If we take the traditional ideologies of left and right at their face value, then it appears that the distinction, when taken to the extreme is as follows:
- The right ideology thinks that society should be like a cold-blooded animal: to have no regulator, but instead simply go with the dynamics of the system itself. Therefore, it's better to have a free society than to control it, even if the latter could give a better foundation.
- The left ideology thinks that society should be "warm-blooded" because the evolution of society, left to its own premises, will result in very bad outcomes (extreme wealth inequality followed by revolt and collapse). Therefore it's better to have a reasonable foundation to keep the system from going out of spec, and if that requires a regulator, so be it
The "regulator" in this case is usually the state. However, the state is organized in a bureaucratic manner, which means it has low variety. Unless the state is a police state, it is limited in what actions it can take, and even for those actions it can take, the inefficiency of the bureaucracy means that the "countermove" is only partially successful in limiting the variety of, say, the economy.
Since the state has low variety, the ideologies above are polar. If the regulator is to permit a high variety in society, it must accept a weakening of its ability to regulate or control. On the other hand, if the regulator is to be successful at what it aims to do, which is to limit unfortunate outcomes, it must somehow manage to have society lower its own variety because the state cannot directly handle its task otherwise - it simply does not have the capacity to do so.
Out of that observation, the tendency of left-leaning central governments to desire uniformity becomes easy to see. The state cannot directly control the parameters it wants (economic ones, for instance), and so will promote what I call a type-2/type-3 or majoritarian concept of equality: that everybody is equal if they're uniform. If the people accepts it, that would greatly reduce the variety of society, potentially bringing control within the grasp of the state[2].
One would also assume, based on the above, that right-leaning governments would forgo regulation altogether. That is certainly a goal of its extreme position, but "right" seldom goes as far as to advocate a free-for-all anarchy, for that would destroy freedom. Even the right wants some regulation, and practically speaking, the economic powers (corporations and private organizations) that tend to benefit from a right position will advocate that they, rather than the state, perform the task of a controller, but for their own purposes.
Even though I didn't specifically intend to reach the conclusion when I first wrote this (in a text file of my own), it's surprising how easily the conclusion follows: if the state doesn't have enough variety to regulate well - which it doesn't, being bureaucratic - it will encourage the system to become more well-behaved so it can.
As for me, I think that if left to its own, the system, at least the economic part of it, is unstable. If there is minimal economic regulation, some entity (a company, most likely) will eventually gain enough power to rewrite the rules. At that point, it can decide to be the new state, and the control it then exercises will not be for the good of the people. Pretty much the same thing applies in the absence of any order at all, except the entities are not only economic, they make use of physical force as well. The different mafia gangs will compete until someone ends up on top, at which point the game is over.
The alternative, though, is not very good either. It is better than being in a cyberpunk future, but if the state cannot regulate directly, it will keep trying to simplify the people so that they can be regulated. What is the answer? I think, and this is my opinion, of course, that the regulator must be set up so that it has the requisite variety - not by making the state a police state, but by design of the organization, decentralization, and so on. A recursive design would help, but it must not become too bogged down in sending messages up and down a hierarchy. With the power granted by the high variety in the regulator, the regulator itself (the "state", or more broadly, the group of organizations handling governing functions) has to be anchored by the wishes of the people. Ideally, it should be radically transparent, free of hierarchy, and incorporate ordinary people so that it will resist corruption for as long as possible.
[1] Generally, it must have as much variety as it's trying to reduce in the system being regulated. A bang-bang (on-off) thermostat can limit temperature in a room to a certain range by using some variety, but a PID controller can make use of the heater's ability to be set at other levels than full blast and nothing at all to regulate to a much tighter range.
[2] The more centralized the state, the more variety it has to deal with, and the greater this effect would be. The effect is the same thing that makes micromanagement so impractical. If a center tries to coordinate everything, even if that center is somehow perfectly honest and not corrupted by power, it soon finds itself overextended and quality suffers.
no subject
Date: 2011-05-19 12:57 am (UTC)It was poorly worded, but your A/C case was a clear counterexample anyway, so I'll withdraw the point. The controller can have greater or lesser variety than its system.
Ideally, we'd want a situation where no shaping at all is required.
Probably you mean something different than I do by "shaping", but that statement just sounds implausible. For instance, language shapes society, and even in a utopian one you'd want to continue improving language, say by incorporating new terms from developing sciences into common parlance. If you meant deliberate shaping, I'll note that the hypothesis I gave (that video games helped decrease violent crime in the US) wasn't a deliberate effect.
If both of these fail or are inapplicable, though, I think the kind of reasoning I wrote in my post would help constructing a better controller/regulator, avoiding the usual traps of corruption, excessive centralization, lack of accountability, and so on.
*nods* Yeah, I think so.
At least, unless we find ourselves in a utopia, the higher level maintenance - deciding where to go, how to shape society, then having that change happen - involves departing from the natural equilibrium, and thus some sort of steering will be required.
I question this. Societies generally improve and develop without steering -- the progress of science is a great example. Societies also push themselves out of equilibrium without any kind of steering, sometimes for the better, sometimes for the worse.
no subject
Date: 2011-05-19 03:22 pm (UTC)To be more precise, by shaping I meant using something that requires continuous maintenance in order to pull the system from its usual equilibrium. Ideally, we'd have (or want to have) a situation where the equilibrium takes care of itself.
This gets a bit more muddy in the case of a society because it is "shaping" (in your sense) itself all the time, which I suppose is your point. Yet from a cybernetic point of view, you still have controllers - it's just the case that these are less separate from the system than you'd usually consider the case for say, a state, because the controllers are the members of society acting upon each other (individually or collectively).
So, one step removed from ideal, you have the "establish the environment and leave" sort of regulation, where you'd have a minimal code (either social or legal) which then results in what was wanted. For instance, the diverse dynamics of capitalism arise from seemingly simple rules[1], and one might imagine that say, adding a rule (whether social or legal) that organizations should (or have to) disclose input-output data, would move the economy closer to a planned form -- without having to build planning agencies before the fact, or impose production orders upon the producers themselves.
I question this. Societies generally improve and develop without steering -- the progress of science is a great example. Societies also push themselves out of equilibrium without any kind of steering, sometimes for the better, sometimes for the worse.
Hm, I'm not sure. It seems to me that as you increase complexity, there are more and more ways things could go "wrong" and fewer ways they could be right. The paths multiply, and it generally seems the buffering technology (that which would work like insulation of the wall) lags. On the other hand, evolution manages to increase complexity on its own, and that is a simple process. I suppose if you leave a system to itself, it will attain some form of equilibrium (and if it degrades from that point, well, that wasn't the equilibrium after all). Whether it's better than what you could have by adjusting it beforehand, taking the possibility of corruption of the adjusting mechanism into account... is another question.
I'll have to think about it further, it just again seems intuitive that one could make shortcuts by coordination, and by knowing how controllers work, one could put the right amplifiers in the right places and get much less corruption/etc; and then, if society becomes reliant on those shortcuts, that means it needs the mechanism just to stay at its current level, unless it later develops a passive ("buffering") solution.
-
[1] and possibly a state to enforce them, that is. Absent a state, the producers would turn on the rules pretty quickly, which one might consider a part of the greater dynamic - but if one does, then that greater dynamic is unstable.
no subject
Date: 2011-06-12 05:35 am (UTC)