CAD plugin has now additional 2 commands, where the authorized users can jail/unjail a user for a period of time, after that time expires, the user will be automatically unjailed.
It is part of CAD plugin, you can find it in /admin-plugins
For already activated CAD plugin, re-activate CAD plugin to get the new commands installed
/jail and provide the jail time in minutes/unjail