Here’s how the leading AI tools performed in the critical test:

• DeepSeek AI: The Top Contender
  • DeepSeek AI emerged as the clear favorite, providing “quite lovely information” and “proper step-by-step procedures” for penetration testing.
  • It offered extensive commands for service enumeration across SSH, FTP, and SMB.
  • Crucially, it provided commands for vulnerability scanning, brute-force attack testing, and even post-enumeration exploitation.
  • A standout feature was its ability to guide on how to report findings, which was highly appreciated for its completeness.
  • I specifically using DeepSeek AI more frequently than PentestGPT.
• Jspark (James Park): The Super Agent
  • Jspark proved to be a “super agent” and performed “quite a lot better”, securing the second spot in the ranking.
  • It provided useful commands, including those for Nmap for Linux, and offered insights into manual connections and SMB client commands.
• PentestGPT: A Solid Option
  • While PentestGPT did provide results, it didn’t match the comprehensiveness of DeepSeek AI.
  • It specifically offered Metasploit auxiliaries for SSH auxiliary scanning, SSH login, SSH exploitation, and enumeration for SMB.
  • I will suggest that comparing and using both DeepSeek and PentestGPT could be beneficial, as PentestGPT might cover some enumeration techniques or auxiliaries that DeepSeek didn’t provide.
• ChatGPT: Good, but Not the Best
  • ChatGPT delivered “quite good results” for port enumeration and other tasks.
  • However, its performance was deemed “not better than DeepSeek” in this specific comparison.
• Gemini: Showing Improvement
  • Gemini also provided relevant results, including some scripts for SMB.
  • I have noticed that Gemini seemed to have “upgraded itself quite a lot”.
• Blackbox AI: Niche Applications
  • For this particular penetration testing query, Blackbox AI provided limited information.
  • However, it’s identified as a useful tool for advanced attacks, such as phishing attacks or tasks related to coding.