The battery doors of the LeapsterGS Explorer are designed to be snug to prevent the batteries from popping out if the device is dropped.
To open the battery door cover, place one thumb on each of the textured arrows of the battery door, then firmly push down and away from the device to release the door.
If you continue to experience difficulties, it may help to utilize a coin to push the textured arrow down and out.