Yes, the fact that Buzz Aldrin had to be evacuated from the South Pole should cause people to be concerned about his health. Buzz Aldrin is an older individual, and it seems that his trip to the South Pole was too stressful for his body to handle. Considering that the severity of his condition warranted an elaborate rescue effort confirms these fears.
He is an older man and getting airlifted and rescued from the South Pole is certainly not a good sign for his heath. He might not be dying, but there are certainly serious problems that he has to overcome, and he will needs some serious care and time in the hospital before he is healthy.
NSF said it received a request from The Antarctic Company - a private tourism business based out of South Africa - to provide a “medical evacuation” for an “ailing visitor.” The release said the NSF agreed to transport Aldrin from its Amundsen-Scott South Pole Station to the McMurdo Station, a U.S.-run research center on New Zealand’s Ross Island. Buzz Aldrin, the second man to walk on the moon, was reportedly in a "stable condition" when he was evacuated from the South Pole early Thursday morning.
In places where the weather is extreme, it doesn't make sense to stay there forever. People don't stay in space forever for the same reason. Without gravity, everything is lighter and their muscles deteriorate. The South Pole has extreme temperatures and it isn't healthy for anyone to stay there for too long.