First conceptual glitch!

Part of the reasoning for this piece is not only to replicate processes which generate glitch-alike or aesthetic-glitch images, but to put into place the conditions which could enable genuinely conceptual glitches to happen. As mentioned, a deliberate attempt to cause a glitch cannot be seen as a true conceptual glitch, so all possible attempts have been made to avoid any foreseeable problems or errors.

I have considered the possibility of being hit by a bus, thus causing the piece to permanently glitch, though of course as it is a simple system, it could be carried out by any person or machine (as long as they have the capacities to perform the task). In the event of my death, it will have to be decided whether the process can be run by a different piece of hardware who could continue the jigsaw generations, or whether the process has permanently glitched, leaving the remaining frames empty. Our first glitch is not quite as dramatic, but does have a visible effect on the generated image.

Firstly, a note about how jigsaws are made:

I have had these jigsaws specially cut to the same pattern by an obliging company called JHG Jigsaws (and a very patient lady called Julie), so that a piece can be taken from a particular grid position on one jigsaw and placed in the same position on another.

Even so, it is not possible to stop the boards from shifting slightly in their frames as they are being cut, meaning that whilst the inner shapes are regular, the edges of the jigsaws are of different lengths. When mixed up together, this leads to jagged edges:

 

Detail from Circuit-bent jigsaw #1 (edge)

 

In addition, virtually all jigsaws are made in two halves which are then attached down the middle (if you pull apart any standard jigsaw, you will notice a gap down the middle where the two halves connect). One side is the rotated copy of the other, so that the bottom left and the top right pieces are the same but 180 degrees rotated. As the middle is also two edges, they also obey the jagged edges rule, and as a result, do not fit together neatly as they would normally.

 

Detail from Circuit-bent jigsaw #1 (centre)

 

I do not consider this a conceptual glitch, as I had predicted it, and the pieces can still be placed together without much interference, though not as tidily.

However, in the creation of Circuit-bent jigsaw #2, it became apparent that there was an anomaly, namely B36 and the pieces either side of it. In short, it was too large to fit the space.

On investigation, I found that Jigsaws 2 and 6 share this anomaly, which is of course mirrored in the bottom left corner at X5 (where the piece was smaller, so could fit, though with some empty space).

This begs the question, how should the system react to such an anomaly? It seems there are 3 options:

1) Leave the piece out

2) Cut the piece/surrounding pieces to fit

3) Replace the piece with a smaller piece from that position from the next jigsaw along.

Option 2) seems like a very human solution to apply to an automated, pre-determined process so can be rejected.

Option 3) suggests an alteration in the programme to accommodate new information, i.e. the system is learning. There is no reason to think that the system has any such capability.

Therefore, Option 1) is the most realistic reaction. The unit contains no information and as such will be left blank, an absence, a dead pixel.

The underlying code: Scene statistics

Following the construction of Circuit-bent jigsaw #2, I had a very interesting chat with Cognitive Scientist Tom Stafford, who pointed out how the piece draws out the underlying statistics of the scenes commonly framed by pictures:

“By rearranging the jigsaws, you destroy the meaningful interpretation of the scene, but continue sampling from the same underlying distribution (which is, as a consequence, highlighted, since the coherent interpretation of a scene is no longer there to distract)”.

He put me on to this research which shows that “scenes”, whilst they may contain different subject matter, generally adhere to a set of principles of composition which are revealed in Circuit-bent jigsaw:


Images from Torralba, A., & Oliva, A. (2003). Statistics of natural image categories. Network: Computations in Neural Systems, 14, 391–412-391–412.

The above images were generated by compiling hundreds of images which conformed to each of the broad subject categories. Though there are variations between natural and man-made environments, scenes are generally lighter at the top, conveying the light source of most environments whether natural or otherwise. They are also constrained by human perspective and as a result are usually viewed from a human standing height. Scenes which involve greater distances tend to be anchored on the horizon and feature smoother textures as visual “clutter” decreases.

These principles can be seen in the Circuit-bent jigsaws, with lighter shades appearing at the top of the images, and the viewer’s eye drawn in to the central, distant point. Though the individual units of the scene have been stripped of their semantic or contextual attributes, they still adhere to a set of predetermined rules, which are retained in the randomised images.

Probability

If you’ve been wondering how many different possible combinations of images there are, there are…….

14166102623834861723796252524915224416640471830910191322323547432140618947596486436347661333869287260068907949302029484915942402681211620694598046617844295512220793103312980549591537160959053027940624117598003417503015722697428176155600362263128567590299511776686592862074376328232990325101248680123776914576482815095784568122986221890411837737570098864613342090972756469661488216176894465388028416768338495326989675118087222767384596111351304957869025273802978281783731929966468210579229830069556698928937342508988340792335737744719376598506908977135291983117722648269177947154657697517074993441515526839887073400191797445153760221695723268255006134044062503100710134200414607696976757837002911389023284338696251543694980946202137938610119300450795091488653253649628649410789376

So that’s nice.