If you are locally hosting your bot, then I am pretty much sure that it's your internet. I will show you an example.
Websocket latency when I host locally:
Websocket latency when I host with Heroku:
I experience late response too when I host locally, while with Heroku it's almost instant.
There are some commands which can take much longer than average commands (For example an aiohttp get/post session for uploading an image to Imgur, which takes about 5 seconds when I host locally, but comes almost instantly when I run with Heroku)