legjobbporno.com
robots.txt

Robots Exclusion Standard data for legjobbporno.com

Resource Scan

Scan Details

Site Domain legjobbporno.com
Base Domain legjobbporno.com
Scan Status Ok
Last Scan4/20/2025, 5:53:21 PM
Next Scan 5/20/2025, 5:53:21 PM

Last Scan

Scanned4/20/2025, 5:53:21 PM
URL https://legjobbporno.com/robots.txt
Domain IPs 104.21.28.141, 172.67.170.219, 2606:4700:3030::6815:1c8d, 2606:4700:3032::ac43:aadb
Response IP 172.67.170.219
Found Yes
Hash dfd6750baf8528b8a68d1fddf3ee5a54613eba187e4b91fc071803b4edbc92d2
SimHash 6601480063b4

Groups

*

Rule Path
Disallow /trazi/
Disallow /info/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3