Log In Sign Up

katetooncopywriter.com.au
robots.txt

Robots Exclusion Standard data for katetooncopywriter.com.au

Resource Scan

Scan Details

Site Domain katetooncopywriter.com.au
Base Domain katetooncopywriter.com.au
Scan Status Ok
Last Scan2024-09-17T04:13:32+00:00
Next Scan 2024-10-17T04:13:32+00:00

Last Scan

Scanned2024-09-17T04:13:32+00:00
URL https://katetooncopywriter.com.au/robots.txt
Domain IPs 35.213.231.97
Response IP 35.213.231.97
Found Yes
Hash 27a9feae1b1f16eed59a4973d70987011631fc5099319f6a268f85d9ff4b0a7b
SimHash de6eca209c91

Groups

*

Rule Path
Disallow

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.katetooncopywriter.com.au/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
  • Ban bots that don't benefit us - from yoast website.
  • --------------------------------
Back to top