This file contains anonymized, hand-labeled responses to the first segment of our Spring 2021 LTL/Electrum Survey.
Participants received the following instructions:
Describe the following Electrum formulas in English. Aim for short, illustrative sentences. For example: - formula: always { Blue not in Panel.lit} - English: "The Blue light is never on." For reference, the ANON template is here: HIDDEN FOR DOUBLE BLIND REVIEW
Q | Red in Panel.lit implies after { after { after { Red in Panel.lit } } } |
A | if Red is initially lit, then it is also lit after three steps |
47 / 57 students correct (82%)
4.40 overall average confidence
917u | 5 | If the red light is on then three states from now it must be on | A possible misconception is the light stays on for all intermediate states |
qMyf | 4 | If the Red light is on (now/in the first slot?), then three steps later, it will be on again. | Maybe, since the "always" word isn't there, someone might think that this meant "whenever the Red light is on, it will be on again three steps later". Or, "whenever the Red light is on, it will only be on again three steps later". |
gbrV | 5 | If the Red light is on right now, it will be on in 3 time steps from now | |
rahc | 5 | If Red is lit in the current state, then on the third state after the current one Red is also lit. | |
N3Cw | 4 | If the Red light is on in this state, the Red light will also be on three states after this state. | |
ydkm | 4 | If the red light is on in the state 0, then in state 3 the red light must be on. | This does not mean that if the red light is on in any state, then three states later it will be red again, it only is true for state 0 as it does not use always. |
c9jy | 4 | If the red light is on, it will be on three turns after this one. | The red light is on every three turns. |
ptyk | 5 | If in the current state, the Red light is on, then in the state 3 states later, the Red light will be on. | A "near miss" might be: if in the current state the Red light is on, then it must remain on for the next 3 states. |
KXjz | 4 | If the red right is lit, then it will also be lit after three states. | If the red panel is lit, then it will be lit for the next three states. |
mxad | 4 | If Red is lit now, it will also be lit 3 states from now. | If Red is lit, it will stay lit for at least three states. OR The red light is never off. |
rnC9 | 5 | If the red light is on during the initial state, then three time steps later the red light is also on. | If the red light is on, then three time steps later the red light is also on. (assumes an "always") |
8E1h | 4 | If the Red light is lit, then the Red light will be lit in three light changes from now. | If the Red light is lit, then the Red light will be lit in three light changes from now, else the Red light will not be lit three light changes from now. |
sain | 5 | if the light is red it will be red again after 3 change of states | the light is always red |
nieh | 5 | If the red light is on, then it will be on again in 3 turns. | |
uOG8 | 3 | If the red light is on, it will be on in the third trace afterwards | |
fsqw | 5 | If the red light in on initially, then the red light is on in the fourth state. | If the red light in on in any state, then the red light is on three states later. |
dznh | 4 | If the Red light is on, it will be on 3 states in the future. | If the Red light is on, it will be on for the next 3 states. |
7opy | 5 | If the Red light is on now, it will be one after 3 transitions. | |
vz2g | 4 | The red light currently being on means it will be on in the third state after the current one. | |
cirf | 5 | If the red light is lit in the current state, it will be lit again after three transitions (no constraints on the red light in between). | If the red light is lit in the current state, it will stay lit for the next three states. |
fojf | 4 | If the Red light is on, then the Red light will be on during the state that is three states in the future. If the Red light is not on, this no other conditions need to be met. | If the Red light is on, then the Red light must have been on in the state that was three states before this state. |
7jm2 | 4 | If the Red light is on now, then the Red light will be on in 3 time units. | The Red light will be on every third time unit. |
eolW | 5 | If the Red light is on, it will be on again after 3 traces. | The Red light is on every 3 traces. |
c1fn | 5 | If the red light is on, it will also be on after three turns (units of time corresponding to state changes). | If the red light is on, it will stay on over the next three turns. |
nr65 | 4 | If Red is lit in the current state, it will be lit in 3 states. | Whenever the Red is lit, it will be lit in 3 states. |
able | 5 | if the red light is lit in the current panel it should be lit after three states too. | |
1vwv | 5 | If the Red light is currently on, then it will be on 3 states in the future. | If the Red light is currently on, then it will be off on the next 2 states and back on in the 3rd future state (false because the formula doesn't constrain the state of the Red light between the current and 4th states). |
yoxy | 4 | When the red light is on in the current state, it's on 3 states in the future. | Whenever the read light is on, it's on 3 states in the future. |
xqZA | 3 | If the Red light is on initially, then it will also be on in 3 time steps. | The Red light will be on every 3 time steps. |
bx1r | 5 | If the red light is on, after 3 state changes (presumably light changes), the red light will be on again | |
w4t3 | 4 | If the red light is on, then the red light is on 3 states later. | |
clU0 | 5 | If the Red light is on right now, then it is also on 3 time steps in the future. | Any time the Red light is on, it is also on 3 time steps in the future. |
ndij | 5 | If the red light is on right now, then after three states, the red light will also on. | If the light is red right now, then after three states, the light will also be red. |
tyos | 5 | If the red panel is lit, then the red panel must also be lit after 3 state transitions. | |
ekny | 5 | If the Red light is on now, it will be on again after 3 states. | The Red light is on now and will be on in 3 states. |
hDZG | 5 | If the red light is on, it will also be on three states in the future. | The red light follows a pattern that repeats every three states. |
yypq | 4 | If the light is red right now, it will be red again in 3 time steps. | |
pfdd | 4 | If the Red light is currently lit, it will also be lit in three time steps. | |
j9mq | 3 | If the red light is on, then it will also be on three time steps into the future. | |
j7t9 | 5 | if red light is on, then after 3 states, red light is on | if one of the lights is red, then after 3 states, at least one of the lights is red |
n4vd | 5 | If the red panel is lit then it will also be lit three instances from now. | |
qjpx | 5 | If the current panel has Red lit, then Red is lit exactly three states after | |
kuaa | 3 | If the Red light is currently only, the Red light will also be on 3 states later. | Not sure if this classifies as a "near miss", but a misconception that a learner may have is that red can only be in lit only after it was already been in Panel.lit (thus creating a sort of paradox) |
XLuy | 3 | The red light being lit means that it will also be lit after 3 instances. | |
xeec | 5 | If the Red light is on, it will be on again in three states. | |
duq8 | 4 | If the panel's light is currently red, then the panel's light will be red again 3 turns later. | N/A |
bxd4 | 5 | When the red light is currently on, the next next next light will be red. ~= (If we call the current state as i, and if red light is currently on in state i, the red light will also be on in the state i+3) | "If the current light is red then the before before before right was red." --Reason why this is wrong: Since it is "implies," we cannot guarantee that the red light won't be lit if the before before before light was not red. But I don't think this issue is about the LTL keywords, more about 'implies' generally. |
iVk5 | 4 | Each time the red light is on, the red light must be on three traces later. | It's important to realize that (after {Red in Panel.lit}) triggers the left side of the implies statement. So, if the red light is on in trace 1, it will be on in trace 4, 7, 10, 13, etc. |
m0p6 | 5 | The red light will be lit every 3 time units given it is lit once at all. | The red light will only be lit every 3 time units. |
DzoD | 4 | The red light is on 3 states following being on previously. (it blinks or is consistently on) | The red light blinks |
XU9x | 4 | Whe the Red panel is lit, it will be lit again in 3 turns. (can you all them turns?) | |
zf66 | 5 | If the red light is lit at a given timestep, it will also be lit 3 turns later | The red light will be lit every three turns. |
s0nv | 5 | After a red light, three turns later there will be another red light. | The red light will occur three more times after the current red light. |
31qw | 5 | Whenever the red light is on, in the next of next of next state, the red light is also on. | Whenever the red light is on, in the subsequent three states, the red light is also on. |
55oa | 3 | There is a Red light guaranteed on every 3rd cycle | The Red light is *only* on every 3rd light. My reasoning: nothing specifies that the in between states can't be Red, just that every 3rd light must be Red |
kkzx | 3 | If the red light is on, then the red light will be on after two other turns. |
3r04 | 5 | If in one state Red is in the Panel.lit, it will also in the Panel.lit in the two states after. |
Q | after { after { eventually { after { Red in Panel.lit } } } } |
A | Red is lit after 3 or more steps |
48 / 57 students correct (84%)
3.63 overall average confidence
917u | 3 | Two states from now there will be some future state such that the state after it will have the red light on. To put in more mathematical terms (sorry) but in pseudo English : If the current state is i then there is a state i+2 and a state x such that x is greater than or equal to i+2 such that in x+1 the red light is on | There could be a lot of confusion about the nesting of the operators and what it means such as thinking that the state after has the red light on or that red light is on 3 states from now. |
qMyf | 4 | After the first two steps, there will be a step at which the Red light will be on directly after. | "After the first three steps, the Red light will be on." |
gbrV | 4 | after 2 time steps, there is eventually a state x such that in the step after x, the red light is on | The order of after might be confusing. i.e. inside out reading or outside to inside reading. i.e. After one step, there exists a state x, s.t. 2 steps after x the red light is on |
rahc | 4 | Two states after the current state, eventually there will be a state in whose following state the red light is lit. | |
N3Cw | 3 | At least three states after the current state, the Red light will be on. | At least two states after the current state, the Red light will be on. |
ydkm | 3 | There is a state i, for i greater than equal to 2, where the next state has a Red light lit. | This does not mean that state 3 must be a red light, just that at some point at state 3 or later there must be a red light. |
31qw | 5 | There is some state, excluding the first two states, in which the next state has the red light on. | |
c9jy | 3 | The red light will be on at some point after at least three turns. | |
ptyk | 4 | Assuming the current state is state i, beginning in state i+2, there will be a state >= i+2 in which the Red light is on in the next state. | |
KXjz | 3 | The red light will be lit after three or more states. | After three or more states the red panel will always be lit. |
iVk5 | 4 | The red light must be on for at least one trace where the trace is preceded by at least 3 traces. | It's easy to get confused when counting a string of "afters." For example, in this formula, the earliest trace that could satisfy the predicate is the fourth trace, not the third. |
mxad | 3 | Starting 3 states from now, at some point the red light will be on. | Starting 2 states from now, at some point the red light will be lit. OR At some point the red light will be lit. |
rnC9 | 5 | Two time steps after the initial state, there will be a state where the red light is just about to turn on | |
sain | 5 | after 3 change of states the light will eventually become red | |
nieh | 4 | After 2 turns (on the third state), the Red light will be on at some point in the future excluding the next turn (third turn). | In 2 states the Red light will be on at some point in the future. |
fsqw | 5 | The red light is on in some state after and including the fourth state. | The red light turns on in some state. |
dznh | 4 | The Red light will be on at some point at least 3 states in the future. | The Red light will only turn on at least 3 states in the future. |
7opy | 5 | The Red light will be on after at least 3 transitions. | |
55oa | 2 | In 2 states, there will be a Red light one or more states away | |
vz2g | 4 | At some point after the second state after the current, Red will be lit, i.e. there will be some state from 3->infinity (0 being the current) that has Red lit. | At some point after the third state after the current, Red will be lit, i.e. there will be some state from 4->infinity (0 being the current) that has Red lit. |
cirf | 4 | The red light is lit at some point after the third state. | The red light is lit at some point after the fourth state. |
fojf | 3 | Starting in the state that is two states in the future, there will be some state at that time or at a later time such that the Red light is lit in the following state | |
7jm2 | 4 | The Red light will be on sometime after 3 time units. | The red light will always be on after 3 time units. |
eolW | 4 | The Red light will eventually be on, on the 3rd trace or later. | |
c1fn | 4 | There exists some state (suppose its index is s), at or after two states beyond the current state, such that the red light is on in the (s + 1)th state. | There exists a state at or beyond the current one where the red light is on. |
nr65 | 3 | In 2 states, there will eventually be some state whose succeding state has Red lit. | In 2 states, Red will eventually be lit. |
m0p6 | 5 | After 3 time units, the red light will be lit on the panel at some point in the future | |
able | 3 | After two states and the red light is lit eventually after one other state | |
1vwv | 4 | Two states in the future, the Red light will eventually be on in the next state (i.e. the Red light will definitely be on at least 3 states in the future). | The Red light will not be on until at least 3 states in the future (false because the formula does not say anything about the Red light in the current or next 2 states). |
yoxy | 4 | In two states from the current state, in some future state, the state after that state will have the red light on. | |
DzoD | 3 | Red light will be on at some point following 3 states from now | |
xqZA | 3 | The Red light will be on at some point after 3 time steps. | |
bxd4 | 3 | At any state, the next next state "i" has a possibility that the red light is on some point after that state("i"). ~= (for any state i, the red light is (guaranteed to be) on at some point starting from i+3) ~= (the red light is on some point after after after the first state.) | |
bx1r | 4 | After two state changes, there will eventually be a state such that in the next, the red light will be on | |
clU0 | 4 | 2 time steps in the future, it will be the case that, eventually, the Red light is on in the next time step. | |
ndij | 3 | Starting from the 4th state, the red light will eventually turn on at some point. | I think it's easy to mix up with the following formula, but I'm not sure how they are different. after { after { after { eventually { Red in Panel.lit } } } } |
tyos | 4 | after 2 state transitions, it must be the case that eventually you will find a state after which the red panel is lit. | |
ekny | 4 | In two states, there will eventually be a state where the Red light is on in the next state. | The Red light will eventually be on. |
hDZG | 4 | Sometime after the first three states, the red light will be on. | Sometime after the first two states, the red light will always be on. |
zf66 | 4 | The red light will be lit at at least one time step after the third timestep. | The red light will be lit at at least one time step after the second/fourth timestep. |
yypq | 3 | after 2 time steps, the red light will turn on after 1 time step eventually | after 2 time steps, the red light will turn on eventually |
pfdd | 4 | At some point after two time steps have passed, the Red light will be about to be lit. | |
s0nv | 3 | The red light will appear at least three turns later. | |
j7t9 | 5 | there is some state after the first 3 states, such that the red light is on | there is some state such that the red light is on |
qjpx | 3 | Red is lit sometime from the fourth states (from the beginning) onward | |
duq8 | 4 | After the two initial turns, there will eventually be a turn whose next turn has red light in the panel. | N/A |
8E1h | 3 | At some point, the Red light is lit in the next light change. | |
xeec | 3 | In the third state, there will eventually be a Red light |
3r04 | 4 | After two states, the Red will in the Panel.lit in the end. | |
XU9x | 4 | The red panel will be lit sometime after 2 turns. | |
j9mq | 4 | The red light is on at least once in the future beyond the next 2 time steps. | |
n4vd | 3 | There is some instance where the red panel is lit which is not the first or second instance. | |
kuaa | 4 | After two states, Red will eventually be in Panel.lit | A misconception that a learner may have is that this may never work, since the after is placed after eventually. However, it important to note that eventually { after { }} can also be classified as eventually. |
XLuy | 1 | After two instances of the red light being lit | |
w4t3 | 3 | Two states later, there will eventually be a state where the red light will turn on. |
uOG8 | 3 | eventually at some point in the future, the red light will be on | |
kkzx | 2 | The red light will eventually be on. |
Q | eventually { Red in Panel.lit } implies always { Blue in Panel.lit } |
A | if Red is eventually lit then Blue is always lit |
48 / 57 students correct (84%)
4.26 overall average confidence
917u | 4 | If the red light will be on now or in some future state that means the blue light must always be on. | The red light will eventually be on . The blue light is always on. |
qMyf | 5 | If the Red light will be on in the future, then the Blue light is always on. | "Whenever the Red light is lit, the Blue light is always lit." |
gbrV | 5 | If there eventually exists a state where the red light is on, then the blue light needs to be always on | |
rahc | 3 | If the red light is eventually lit at some point in the future, then blue light is always lit from now till the end. | |
N3Cw | 4 | If there is a current or future state where the Red light is on, then the Blue light is always on in all states. | |
31qw | 5 | If red is ever going to be on, then blue is always on. | Reading it as eventually ({ Red in Panel.lit } implies always { Blue in Panel.lit }) instead of (eventually { Red in Panel.lit }) implies (always { Blue in Panel.lit }) |
c9jy | 4 | If the red light turns on at some point, then the blue light is on. | |
ptyk | 5 | If there exists some state now or in the future in which the Red light is on, then the Blue light is always on (beginning now, not when the Red light is on) | If there exists some state now or in the future in which the Red light is on, then the Blue light is always on beginning at the state in which the Red light is on |
KXjz | 5 | If the red light is ever lit, then the blue light will always be lit. | At some later late, it will always be that if the red light is on the blue light will be on. |
iVk5 | 5 | If the red light ever turns on, the blue light is always on. | |
mxad | 4 | Blue is always lit (starting now) if red ever turns on. | If red is ever lit, blue has been and will always be on. |
rnC9 | 5 | If the red light is going to turn on then the blue light is always on | |
8E1h | 4 | if the Red light is lit at some point, then the Blue light will be lit though out all of the possible states | |
sain | 3 | if the light becomes red then the light will always be blue | |
nieh | 5 | If the red light will be on at some point in the future, then the blue light is always on. | |
fsqw | 5 | If the red light ever turns on, then the blue light must always be on. | |
7opy | 3 | If the Red light is on or will be on, the Blue light is always on. | At some point in the future, the Red light is on and the Blue light is always on after that. |
55oa | 4 | The Blue light is on as long as the Red light will be on at some point | |
vz2g | 4 | If Red is lit at some point in the future, then Blue must always be lit. | |
fojf | 4 | If there is some state now or in the future such that the Red light is on, then the Blue light is on at every state in the past, present, and future. | If there is some state now or in the future such that the Red light is on, then the Blue light is on at every state in the present and future. |
7jm2 | 4 | If the Red light will eventually be on, then the Blue light must always be on. | |
eolW | 5 | If the Red light is ever on, the Blue light is always on. | If the Blue light is always on, the red light will be on sometime. |
c1fn | 5 | If there is a state at or beyond the current state where the red light is on, then the blue light is always on. | If there exists a state at or beyond the current one where the red light is on, then the blue light has always been on. |
nr65 | 4 | If Red is ever lit in the future, then Blue is always lit. | Blue is always lit and Red will eventually be lit. |
m0p6 | 5 | If the red light is ever lit, the blue light is always on. | |
1vwv | 4 | If the Red light will be on at some point in the future, then the Blue light will always be on. | If the Red light is on at some point in the future, then the Blue light will be on from that point forward (false because `eventually` applies to `{Red in Panel.lit}`, not the entire formula -- and `always` doesn't work that way anyway). |
xqZA | 3 | If the Red light is on at some point, then the Blue light would always have to be on. | |
bxd4 | 4 | If the red light is on at some point, blue light is always on. | |
bx1r | 4 | If the red light eventually turns on, then the blue light is always on | |
clU0 | 5 | If the Red light is eventually on, then the Blue light is always on. | |
ndij | 5 | If the red light eventually turns on at some point, then the blue light is always on. | |
tyos | 4 | If the red panel will be lit eventually, that means the blue panel is lit and will always be lit (ok I'm now learning multiple panels may be lit @same time). | |
ekny | 3 | If the Red light will be on eventually, the Blue light will always be on. | Eventually, the Red light will be on and the Blue light will always be on. |
hDZG | 4 | If the red light is ever on, the blue light will always be on. | If the red light ever turns on, the blue light will at that point turn on and stay on. (Unless I got the order of operations wrong, in which case my first answer is wrong and this one is right.) |
zf66 | 5 | If the red light is ever lit, the blue light will always be lit both before and after the red light lights up. | When the red light lights up, the blue light will light up and remain lit. |
yypq | 5 | If the red light eventually turns on, then the blue light should always be on | |
pfdd | 5 | If Red is ever lit, Blue is always lit. | |
s0nv | 5 | If the red light is ever on, then the blue light will always be on. | |
j9mq | 4 | If the red light turns on at some point in the future, then the blue light will always be on from the current time step forward. | If the red light turns on in the future, then the blue light will always be on from that point forward. |
j7t9 | 5 | if red light will ever be on, then blue light is always on | |
n4vd | 5 | If the red panel is lit at some point then the blue panel is always lit | |
qjpx | 3 | If Red is eventually lit in some state, then blue will be lit in every state | |
kuaa | 5 | If Red is ever in Panel.Lit, that must mean that for all states, Blue must always be in Panel.Lit | That the implies in this case means that Blue always being in Panel.lit mean that Red should eventually be in Panel.lit (this is not necessarily the case) |
xeec | 5 | If the red light will ever be on in a future state, then the blue light is always on | |
duq8 | 4 | If the panel will eventually shine red, then the panel will always have blue light. | N/A |
3r04 | 5 | If Red is in the Panel.lit in the end, Blue will always in the Panel.lit. | |
kkzx | 3 | If the blue light is not always on, then the red light will not be on in the future. | |
DzoD | 5 | Red will only ever turn on if Blue is never off. | red can only turn on while blue is on |
ydkm | 4 | At some point in the trace, a red light implies that every color after that red light is blue. | This does not mean that any red light implies that it will always be blue after. |
uOG8 | 4 | if the red light is on at some point in the future, then after that the blue light will always be on | |
able | 4 | The light red is lit eventually in a future state after the current state and after that the blue light is always lit. |
dznh | 4 | If the Red light ever turns on, the Blue light must always be on in the future. | The Red light will eventually turn on and the Blue light must have never been off. |
yoxy | 1 | If the red light ever becomes lit in a future state, the blue light will then be on for all future states from that state (inclusive) | |
w4t3 | 4 | When the red light turns on, the blue light will always stay on. |
XLuy | 4 | The red light being lit means that the blue light is always lit. |
cirf | 4 | There is a state after which either the red light is never lit or the blue light is always lit. | There is a state after which the red light and blue light are either both on or both off. |
XU9x | 5 | After a certain point, the Red panel will only ever be lit when the Blue panel is lit. |
Q | { Red in Panel.lit until Blue in Panel.lit } and always { Red in Panel.lit } |
A | Blue is eventually lit and Red is always lit |
28 / 57 students correct (49%)
3.98 overall average confidence
gbrV | 5 | The red light is on until the blue light is turned on, and the red light is always one | |
rahc | 4 | Two conditions are true: 1) red light is lit until blue light gets lit, 2) red light is always lit. | |
31qw | 5 | Red is on in this and all subsequent states, and in this state or in some subsequent state, blue is on. | Red is on in all states before and after, and blue is on in all states after. |
c9jy | 4 | The red light is on and the blue light eventually turns on. | The red light is on until the blue light is turned on. |
KXjz | 4 | The red light will be lit until the blue light is lit and the red light will always be lit. | |
iVk5 | 5 | The red light is always on, and the blue light is on in at least one trace. | The blue light being on does not imply that the red light must be off -- "once" doesn't enforce anything about the LHS formula after the RHS formula holds. |
uOG8 | 3 | the red light will always be on, at some point the blue light will be on | |
fsqw | 5 | The red light is always on and the blue light is on in some state. | The red light is always on and the blue light turns on in some state, after which it remains on. |
dznh | 3 | The Red light is always on, and the Blue light will turn on in the future. | The Red light is always on, and the Blue light will never turn on. |
7opy | 5 | The Red light is always on. The Blue light will be on. | |
cirf | 4 | The red light is always on and the blue light eventually turns on at some point. | The red light is always on and the blue light never turns on. |
fojf | 4 | The Blue light will be on at some point in the present or future, and the Red light is always lit | The Red light is on until the Blue light turns on at which point the Red light turns off. So, this formula is always unsatisfiable because the Red light is not always on. |
1vwv | 5 | The Red light is always on and the Blue light is on at some point in the future. | UNSAT - Red will never turn off so Blue will never turn on, meaning the `until` is not satisfied (false because the first formula of `until` does not need to be false when the second formula is satisfied, so Red can be on forever and the `until` only guarantees that Blue is eventually on). |
ndij | 4 | The red light is always on no matter what, and the blue light is on at some point. | The red light is always on until the blue light is on, and the red light turns off after the blue light is on. |
hDZG | 5 | The red light is always on, and the blue light turns on at some point. | The red light is always on, and the blue light never turns on. |
XU9x | 4 | The red panel will stay lit until the Blue panel becomes lit (after which point its possible, but not guaranteed, that it will turn off), and the red panel will ways be lit. | The red panel will stay lit until the Blue panel becomes lit (after which it must turn off), and the red panel will ways be lit. This would result in the blue panel never turning on |
pfdd | 5 | Red will be lit at least until blue is lit, and red will always be lit. | |
s0nv | 3 | The red light is always lit, and the blue light is also lit at some point in time | UNSAT: Could misinterpret red light on until blue light on as saying that the red light is not on once the blue light is on, which would contradict always {Red in Panel.lit} |
j9mq | 5 | The red light is always lit and the blue light is lit at least once in the future. | The red light is always lit and the blue light isn't constrained. |
qjpx | 4 | Red is always lit and Blue is eventually lit in some state | |
kuaa | 4 | In all states before Blue is in Panel.lit, red is in Panel.lit. Also, Red is always lit. Important to note that this is satisfiable as Red can be in Panel.lit even after Blue is in Panel.lit | That this would not be satisfiable, as Blue cannot be in Panel.lit until Red ceases to be in Panel.lit. |
N3Cw | 4 | The Red light is on in all states from now until the state where the Blue light is on, and the Red light is always on. | |
w4t3 | 3 | The red light is always on until the blue light is on, and the red light remains always on | |
clU0 | 5 | The Red light is on until the Blue light is on, and the Red light is always on. | |
yypq | 2 | The red light will be on until the blue light is on and the red light is always on | |
XLuy | 2 | The red light is lit until the blue light turns on and the red light is always lit. | |
duq8 | 4 | The Panel's light will always be red until it turns blue, and the light will always be red. | N/A |
ydkm | 4 | Red will be lit in every state from state 0 until a state where blue is lit, and also red is always lit. | Red is lit until the blue light is lit and from then on red is no longer lit, and also red is always lit. |
vz2g | 4 | Blue is never lit. | |
3r04 | 5 | Red will always in the Panel.lit and Blue will never in the Panel.lit. | |
ptyk | 5 | The Red light is on in all states from now until the Blue light is on and the Red light is aways on. This will only be true if the Blue light is never on. | The Red light is on until the Blue light is on, but then will be on again after. |
mxad | 3 | The Red light is always on, and the Blue light is never on. | The red light is on until the blue light is turned on (I say this because this kind of implies that this is a possibility, whereas in my answer I try to convey that it isn't) |
8E1h | 3 | The red light is lit until the Blue light is lit, but since the Red light is always lit, the Blue light is never lit. | |
55oa | 3 | The Red light only turns off when the Blue light is on, but the Red light is always on | |
eolW | 5 | The Red light is always on. The Blue light is never on. | |
c1fn | 4 | The red light must stay on until the blue light turns on for the first time at or beyond the current state AND the red light must always stay on. This reduces to an obligation for the red light to always on stay for all states including and beyond the current one. | The red light must stay on until the blue light turns on for the first time and must remain off after that AND the red light must always stay on. This implies the blue light must never turn on. |
yoxy | 4 | Red will always be lit, blue will never be lit. | |
DzoD | 3 | Red is always on, blue is never on | Red turns off once blue turns on |
bxd4 | 3 | The red light is always turned on, and the Blue light is never on. | The learner might not understand that the blue light is never on. |
tyos | 4 | Red panel will be lit in every state until (non-incl) Blue panel is lit. Also, Red panel is always lit. (so the first statement is kind of useless then). | The incl/non-incl aspect of until is tricky. I'd refer to docs to make sure which it is. |
kkzx | 2 | The red light is always on and the blue light will never be on. |
nr65 | 3 | The Red is constantly lit until (if ever) the Blue becomes perpetually lit, at which point the Red will be perpetually unlit. Additionally, the Red is always lit. | Before some state, Red is always lit. After some state, Blue is always lit. And Red is always lit. |
nieh | 5 | The red light is always on, but the red light is on until the the blue light is on, meaning there could be a contradiction. |
bx1r | 4 | The red light is always on. The blue light may turn on. | |
zf66 | 5 | The red light will always be lit, and the blue light may light up at some point. | The red light will always be lit, and the blue light will never light up. |
qMyf | 4 | The Red light is always lit. | Not a near miss, but I'm pretty sure the first half doesn't matter? |
7jm2 | 3 | The red light is always on. | |
sain | 5 | the light is always red | |
m0p6 | 5 | The red light is always lit | |
able | 4 | The red light is always lit | |
xqZA | 3 | The Red light is always on. | |
ekny | 3 | The Red light will always be on. | The Red light will always be on until the Blue light is on. |
n4vd | 3 | The red panel should always be lit | |
xeec | 5 | The red light is always on | |
917u | 4 | The red light is on until the blue light is turned on and the red light is always on. Essentially the red light is always on. | The red light is always on until the blue light is turned on. |
rnC9 | 5 | the red light is always on and the blue light is always either on or going to turn on in the future. |
j7t9 | 4 | if red light is always on before blue light is ever on, then red light is always on |
Q | always { Red in Panel.lit implies { after { Red not in Panel.lit } and after { after { Red in Panel.lit } } } } |
A | whenever Red is lit, it turns off in the next state and on again in the state after that |
48 / 57 correct (84%)
4.32 overall average confidence
917u | 4 | For any given state if the red light is on then in the next state it is off and then two states from now it is on again. | For any given state if the red light is on then in the next state it is off and then three states from now it is on again. |
qMyf | 4 | Whenever the Red light is lit, it will not be lit one step later, and it will be lit two steps later. | |
gbrV | 5 | It is always true that in every state, if the read light is on, it will not be on in the next step and it will be on again in 2 steps. | |
rahc | 4 | It is always the case that: if red light is lit, then red light is not lit in the following state and red light is lit again in the state that follows that (ie. two states from now). | |
N3Cw | 3 | It's always true that if the Red light is on, then the Red light will not be on in the next state and the Red light will be on in the state after that. | |
ydkm | 5 | For any state i, red being lit implies that in state i+1 red must not be lit, and in state i + 2 red must be lit. | |
31qw | 5 | Whenever red is on in a state, it is off in the next state, and on again in the state thereafter. | |
c9jy | 4 | If the red light is on, then the red light turns off on the next turn, and then turns back on two turns from now. | |
ptyk | 5 | In all states, it will be true that, if the Red light is on, in the next state it will not be on, and in the state that follows the next state (i+2), the Red light will be on again. | If the Red light is always on, then in the next state, the Red light will be off, but then will turn back on again in the following state. |
KXjz | 5 | it will always be that if the red light is lit then red will not be lit in the next state and it will be lit two states later. | |
iVk5 | 5 | Once the red light is on, for all of the remaining traces, the red light switches from on to off or off to on in each trace. | |
mxad | 4 | If the red light is not off, it must be flickering (turning on and off consecutively) | The red light must be flickering (turning on and off consecutively). |
rnC9 | 5 | If the red light ever turns on it will blink on and off forever | |
8E1h | 4 | It will always be true that if Red is lit, Red is not lit in the next light change and Red will be lit in the light change two changes in the future. | At some point the light pattern for Red is on-off-on. |
sain | 4 | the light will never stay in red after a change of state and, if it becomes red, it will be red again after two change of states | |
nieh | 5 | From now on, whenever the red light is on, in the next turn it will be off, and in the turn following that it will be on again. | |
fsqw | 5 | If at any point the red light is on, then it must be off in the next state and on in the state after the next state. | If at any point the red light is on, then it must be off in the next state and on two states after the next state. |
dznh | 4 | If the Red light ever turns on, it will blink on and off forever. | The Red light will blink on and off forever. |
7opy | 5 | If the Red light is on, it will be off in the next state and be on again in the next of the next state. | |
cirf | 4 | If the red light ever turns on, it will alternate being on and off forever after. | The red light is always "flickering" (on in one state, off in the next, on in the one after that, etc.). |
fojf | 5 | For every state, if the Red light is on in the given state, the Red light will not be on in the following state, and the Red light will be on in the state that occurs two states in the future | |
c1fn | 4 | If the red light is ever on (suppose this happens in the state with index s), then it will follow a cycle where it is on for all states (s + 2k) and off for states (s + 2k + 1), where k is a non-negative integer. It is also possible that the red light never turns on. | The red light will always follow a cycle of being alternately on and off. |
nr65 | 4 | Whenever Red is lit, the next state will have Red be unlit and in 2 states, Red will be lit again. | Red alternates from being lit and unlit (could never be lit). |
m0p6 | 5 | The red light is blinking on and off, given it turns on once. | |
able | 4 | Whenever a red light is lit. The one state is after the light is not lit and two states after the light is lit again. | |
1vwv | 5 | It is always true that if the Red light is currently on, then it will be off in the next state and back on in the state after that. | The Red light constantly switches between on and off in each subsequent state (false because the Red light may always be off, so it never invokes the `always` requirement). |
yoxy | 4 | In all states, if red is lit in the current state, then in the next state red wont be lit, and two states from the current state red will be lit. | |
xqZA | 3 | Whenever the Red light turns on, it will then turn off, then will turn on back again (the first time it's on will start a cycle). | |
bxd4 | 3 | When the red light is on this state, it won't be on the next state, but it will be on the next next state. This repeats. Red light: OXOXOXOXO ( for example..) | |
bx1r | 5 | In every state, if the red light is on, then the red light wont be on in the next state, and will be on in the state after next | |
w4t3 | 4 | If the red light is ever on, the red light is not afterwards, and it turns on two states later. | |
clU0 | 5 | Whenever the Red light is on, it is not on in the next time step, but it is on 2 time steps later. | |
ndij | 5 | This rule is always true: if the red light is on, then one state after the red light is off, and two states after the red light is on. | |
tyos | 5 | Its always the case that a red panel lit state implies that the next state will not be red panel lit and the following state will be red panel lit. This is like an alternating on/off trace. | |
hDZG | 5 | If the red light ever turns on, it then starts blinking forever with a period of 2. | The red light will blink forever with a period of 2. |
XU9x | 5 | Once the panel has been lit once, the panel will turn off and on forever (at intervals of one turn). | |
zf66 | 5 | If the red light ever turns on, it will start blinking (alternating on and off each timestep) forever. | The red light will blink (alternate on and off each timestep) forever. |
kkzx | 2 | It is always the case that if the red light is on, it will not be on the next turn, but it will be on the next next turn. | |
yypq | 3 | It is always true that if the red light is on, in the next time step the red light will not be on and the red light will be back on in 2 time steps | |
pfdd | 5 | If red is ever lit, it will then continually blink off and on. | |
j9mq | 4 | if red is ever lit, then it will always alternate between unlit and lit in future time steps. Otherwise red is never lit. | |
j7t9 | 4 | whenever red is on, it turns off and back on alternately | |
qjpx | 5 | If Red is lit in some state, then it will not be lit in the next state, but will be lit again in two states after. In another word, Red light is alternating between lit and not lit. | |
kuaa | 4 | In all cases/states, if Red is in Panel.lit in a given state, Red is not in Panel.lit in the following state. However, if Red is in Panel.lit in a given state, Red is in Panel.lit two states later. If we were to condense this, this would basically mean once Red is in Panel.lit, it is in Panel.lit in every other state. | Once red is in panel.lit, red can never again be in panel.lit due to the corresponding "after" |
XLuy | 3 | It's always the case that the red light being lit means that immediately afterwards it is not lit but two instances after it becomes lit again. | |
duq8 | 4 | For all turns, if the panel is red in the current turn, then the next turn the panel won't be red, but in the next next turn, the panel would be red again. | N/A |
3r04 | 4 | In every state, if in one state, Red is in the Panel.lit, the next state it will not in the Panel.lit and come back after two states. | |
eolW | 5 | If the Red light is on, it will turn off in the next trace, and then turn on again. This will repeat forever. (The Red light alternates on and off forever) |
uOG8 | 5 | the red light will always alternate being on and off | |
55oa | 4 | The Red light blinks from on to off to on to off (repeated forever) | The red light goes from on to off, then a break (where it can either be off or on), then it turns back on again |
DzoD | 3 | Red light is constantly blinking. On 2 states off 1 | |
ekny | 4 | The Red light will constantly switch between on and off states. | |
s0nv | 4 | The red light will be on in every other state and off in the remaining states. (Pattern: Red = On, Red = Off, Red = On...) | |
xeec | 5 | The red light will be on in every other state |
vz2g | 4 | Red alternates on and off through each state forever, provided it is currently on. | Red alternates on and off through each state forever. |
n4vd | 5 | If the red panel is lit, then it should not be lit in the instance after but it should be lit in the instance after that. | The red panel is lit every other instance starting with the first. |
7jm2 | 4 | If the red light is on now, then it won't be on in the next time unit, but it will be on in 3 time units. |