Change of default style not applying to guests

When I change the default style in Admin CP, I then logout to make sure that the change has gone through for guests, but it hasnt, the old style is still visible for them...