If a traffic signal light is not working, you must:

If a traffic signal is not working and no lights are showing, you should proceed cautiously as if the intersection is controlled by stop signs in all directions.
DMV Writen Test