Robots that have visited the site
since 1 month

Here are the 28 robots identified thanks to their User Agent (sometimes faked), host or IP adress:

  1. AhrefsBot  
  2. Amazonbot  
  3. Applebot  
  4. Baiduspider The robot did not respect robots.txt rules.
  5. bingbot The robot did not respect robots.txt rules.
  6. BUbiNG  
  7. DataForSEO Link Bot  
  8. DotBot  
  9. DuckDuckGo The robot only explores the home page.
  10. Google-Site-Verification  
  11. Googlebot  
  12. googleusercontent robot  
  13. GPTBot The robot did not respect robots.txt rules.
  14. Mail.Ru  
  15. MojeekBot  
  16. petalbot  
  17. Python-urllib  
  18. Qwantify  
  19. SemanticScholar The robot only explores the home page.
  20. SemrushBot  
  21. SEOkicks  
  22. start.me  
  23. SurdotlyBot  
  24. test  
  25. WebMeUp  
  26. WebwikiBot  
  27. wpbot The robot only explores the home page.
  28. Yandex  

Here are the IP adresses of 105 robots using a browser User Agent:

This list does not include the robots spamming the site or looking for vulnerabilities.

  1. 104.250.164.106  
  2. 109.122.245.82  
  3. 121.237.36.*** The robot only explores the home page.
  4. 128.241.232.*** The robot did not respect robots.txt rules.
  5. 128.241.235.*** The robot did not respect robots.txt rules.
  6. 13.220.81.129 The robot only explores the home page.
  7. 139.59.230.32  
  8. 141.94.194.132  
  9. 147.185.132.171 The robot only explores the home page.
  10. 152.53.1.106  
  11. 152.53.101.59  
  12. 152.53.108.222 The robot did not respect robots.txt rules.
  13. 152.53.109.42 The robot did not respect robots.txt rules.
  14. 152.53.110.*** The robot did not respect robots.txt rules.
  15. 152.53.111.250  
  16. 152.53.12.144 The robot did not respect robots.txt rules.
  17. 152.53.12.30  
  18. 152.53.135.226  
  19. 152.53.14.123  
  20. 152.53.15.148 The robot did not respect robots.txt rules.
  21. 152.53.16.147  
  22. 152.53.16.197  
  23. 152.53.17.93 The robot did not respect robots.txt rules.
  24. 152.53.19.174  
  25. 152.53.19.214 The robot did not respect robots.txt rules.
  26. 152.53.2.*** The robot did not respect robots.txt rules.
  27. 152.53.20.190  
  28. 152.53.3.30  
  29. 152.53.3.94 The robot only explores the home page.
  30. 152.53.35.50  
  31. 152.53.44.217  
  32. 152.53.47.138 The robot did not respect robots.txt rules.
  33. 152.53.47.144  
  34. 152.53.47.149  
  35. 152.53.49.184  
  36. 152.53.49.201  
  37. 152.53.51.144  
  38. 152.53.52.*** The robot did not respect robots.txt rules.
  39. 152.53.53.44  
  40. 152.53.55.67  
  41. 152.53.64.157  
  42. 152.53.67.185  
  43. 152.53.84.74 The robot did not respect robots.txt rules.
  44. 152.53.85.*** The robot did not respect robots.txt rules.
  45. 152.53.86.*** The robot did not respect robots.txt rules.
  46. 152.53.87.225  
  47. 152.53.87.237 The robot did not respect robots.txt rules.
  48. 158.62.208.61  
  49. 159.65.127.31  
  50. 172.207.158.211  
  51. 176.56.185.96  
  52. 183.134.59.131 The robot only explores the home page.
  53. 184.94.240.88 The robot only explores the home page.
  54. 185.117.225.*** The robot only explores the home page.
  55. 188.172.229.121  
  56. 188.68.34.94 The robot did not respect robots.txt rules.
  57. 188.68.38.34 The robot did not respect robots.txt rules.
  58. 188.68.53.142 The robot did not respect robots.txt rules.
  59. 188.68.55.12 The robot did not respect robots.txt rules.
  60. 192.227.120.199 The robot only explores the home page.
  61. 194.5.53.***  
  62. 196.251.72.247  
  63. 198.235.24.*** The robot only explores the home page.
  64. 202.61.203.27  
  65. 202.61.238.111 The robot did not respect robots.txt rules.
  66. 205.210.31.*** The robot only explores the home page.
  67. 209.240.99.195  
  68. 216.73.216.***  
  69. 221.178.143.70 The robot only explores the home page.
  70. 36.150.60.24 The robot only explores the home page.
  71. 37.120.179.43 The robot did not respect robots.txt rules.
  72. 37.120.184.*** The robot did not respect robots.txt rules.
  73. 37.120.185.179  
  74. 37.120.186.137  
  75. 37.120.187.*** The robot did not respect robots.txt rules.
  76. 37.221.197.60  
  77. 4.197.236.174  
  78. 45.141.215.142 The robot only explores the home page.
  79. 45.156.128.*** The robot only explores the home page.
  80. 45.156.129.*** The robot did not respect robots.txt rules.
  81. 45.84.107.54 The robot only explores the home page.
  82. 46.232.250.88  
  83. 46.38.238.73 The robot did not respect robots.txt rules.
  84. 46.38.241.197 The robot did not respect robots.txt rules.
  85. 46.38.253.187 The robot did not respect robots.txt rules.
  86. 47.238.13.***  
  87. 47.242.230.***  
  88. 47.82.11.***  
  89. 52.206.84.190 The robot only explores the home page.
  90. 85.203.44.***  
  91. 89.58.0.163 The robot did not respect robots.txt rules.
  92. 89.58.16.178  
  93. 89.58.17.216 The robot did not respect robots.txt rules.
  94. 89.58.18.243  
  95. 89.58.19.180  
  96. 89.58.29.40 The robot did not respect robots.txt rules.
  97. 89.58.30.159  
  98. 89.58.32.241 The robot did not respect robots.txt rules.
  99. 89.58.43.156 The robot did not respect robots.txt rules.
  100. 89.58.43.25  
  101. 89.58.44.37  
  102. 89.58.46.75  
  103. 89.58.50.247  
  104. 89.58.62.110 The robot did not respect robots.txt rules.
  105. 94.30.52.242 The robot only explores the home page.

Display all the recent visits of this site or a more frequently visited site.

Origin of the robots.

Robots asking for robots.txt.

With javascript

W3C XHTML 1.0
W3C CSS