laliga-xtra.tn
robots.txt

Robots Exclusion Standard data for laliga-xtra.tn

Resource Scan

Scan Details

Site Domain laliga-xtra.tn
Base Domain laliga-xtra.tn
Scan Status Ok
Last Scan2024-11-04T13:34:20+00:00
Next Scan 2024-12-04T13:34:20+00:00

Last Scan

Scanned2024-11-04T13:34:20+00:00
URL https://www.laliga-xtra.tn/robots.txt
Domain IPs 3.164.182.103, 3.164.182.119, 3.164.182.33, 3.164.182.53
Response IP 65.9.112.86
Found Yes
Hash 18e05119280bd9a09e9dac16909b45eaf06e17c9a84adaaac299fafc898880b3
SimHash ef20dcc0e3f3

Groups

adsbot-google-mobile

Rule Path
Disallow

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /protected