Should I remove all query parameters?

No. A parameter can identify useful content, such as a page of results, or merely duplicate the same page with tracking information. The crawler preserves query strings because it cannot determine their meaning reliably.

Review the actual destination and your canonical policy. Keep meaningful public URLs and deselect redundant tracking variants. Never submit a URL containing private session identifiers or access tokens.