itipfooty.com.au
robots.txt

Robots Exclusion Standard data for itipfooty.com.au

Resource Scan

Scan Details

Site Domain itipfooty.com.au
Base Domain itipfooty.com.au
Scan Status Ok
Last Scan2024-11-12T07:53:55+00:00
Next Scan 2024-11-19T07:53:55+00:00

Last Scan

Scanned2024-11-12T07:53:55+00:00
URL https://itipfooty.com.au/robots.txt
Domain IPs 64.151.229.244
Response IP 64.151.229.244
Found Yes
Hash 260f3fff086df37a54d8325f9ebd28c14c0f47489a9b9148ea57491528560414
SimHash aa78ca2aa3d3

Groups

*

Rule Path
Disallow /includes/
Disallow /applogfiles/
Disallow /iPhone/
Disallow /procs/
Disallow /avatars/
Disallow /mjezdaa/
Disallow /tests/
Disallow /mobile/
Disallow /MobileApp/
Disallow /assets/*
Disallow /services/
Disallow /assist/

admantx

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

phpcrawl

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Comments

  • Block Admantx Bot
  • Block Mail.Ru
  • Block PHPCrawl Bot
  • blocks Yandex