wpdatatables.com
robots.txt

Robots Exclusion Standard data for wpdatatables.com

Resource Scan

Scan Details

Site Domain wpdatatables.com
Base Domain wpdatatables.com
Scan Status Ok
Last Scan2024-09-21T05:52:27+00:00
Next Scan 2024-10-21T05:52:27+00:00

Last Scan

Scanned2024-09-21T05:52:27+00:00
URL https://wpdatatables.com/robots.txt
Domain IPs 172.66.40.114, 172.66.43.142, 2606:4700:3108::ac42:2872, 2606:4700:3108::ac42:2b8e
Response IP 172.66.43.142
Found Yes
Hash 2708f6cf444b195a6275f91ece1ce7795f8b48a33cb2c739a891349e5eea32c1
SimHash e800da0263b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /tag/
Allow /wp-admin/admin-ajax.php