It could harm the battery.

After a couple weeks, the battery began to die at 10-40%

The battery in the new phone also showed the same problems soon after and once I removed the magnet the problems persisted

The magnets is strong, but not as strong as it needs to be