Log In Sign Up

search-log-1.tapatalk.com
robots.txt

Robots Exclusion Standard data for search-log-1.tapatalk.com

Resource Scan

Scan Details

Site Domain search-log-1.tapatalk.com
Base Domain tapatalk.com
Scan Status Ok
Last Scan2025-10-19T02:56:00+00:00
Next Scan 2025-11-18T02:56:00+00:00

Last Scan

Scanned2025-10-19T02:56:00+00:00
URL https://search-log-1.tapatalk.com/robots.txt
Domain IPs 172.66.132.33, 172.66.132.34, 2606:4700:10::ac42:8421, 2606:4700:10::ac42:8422
Response IP 172.66.132.33
Found Yes
Hash ed3ff1740eb0d3cfbcf28790b8797f572a59ddfd1c1e02e30ec6b5e23a53d8f4
SimHash 6834da20c5da

Groups

googlebot
google
mediapartners-google
bingbot
bing
facebookexternalhit
duckduckbot
applebot
gptbot

Rule Path
Allow /

*

Rule Path
Disallow */mcp.php
Disallow */memberlist.php
Disallow */ucp.php
Disallow */viewonline.php

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /
Back to top

Comments

  • Allow important bots
  • Block specific .php files globally, regardless of their location
  • Set crawl delay to avoid server overload
  • Block all other unwanted bots
Back to top