If you dig a hole in the south pole are you digging up or down?

By default, a hole will be dug downwards. It does not matter whether you are in the north pole or south pole or anywhere on the earth geographically, you dig a hole only downwards. So you will be going down.