Fail2ban is a framework that you can use to scan log files (e.g. /var/log/apache/error_log) and bans IPs that show the malicious signs