padawan.info
robots.txt

Robots Exclusion Standard data for padawan.info

Resource Scan

Scan Details

Site Domain padawan.info
Base Domain padawan.info
Scan Status Ok
Last Scan2025-11-06T23:30:50+00:00
Next Scan 2025-12-06T23:30:50+00:00

Last Scan

Scanned2025-11-06T23:30:50+00:00
URL https://padawan.info/robots.txt
Redirect https://www.padawan.info/robots.txt
Redirect Domain www.padawan.info
Redirect Base padawan.info
Domain IPs 185.31.40.25, 2a00:b6e0:1:20:16::1
Redirect IPs 185.31.40.25, 2a00:b6e0:1:20:16::1
Response IP 185.31.40.25
Found Yes
Hash dab62ace14b255c6ad0adf3847ffcac9bf62772f84d158c8ffff64276379d1b4
SimHash 785152458653

Groups

*

Rule Path
Disallow /cgi-bin/

usyd-nlp-spider

Rule Path
Disallow /

e-societyrobot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

Other Records

Field Value
sitemap http://padawan.info/sitemap.xml