Log In Sign Up

andreabelcher.artfunnels.com
robots.txt

Robots Exclusion Standard data for andreabelcher.artfunnels.com

Resource Scan

Scan Details

Site Domain andreabelcher.artfunnels.com
Base Domain artfunnels.com
Scan Status Ok
Last Scan2026-01-08T12:19:17+00:00
Next Scan 2026-02-07T12:19:17+00:00

Last Scan

Scanned2026-01-08T12:19:17+00:00
URL https://andreabelcher.artfunnels.com/robots.txt
Domain IPs 104.21.53.111, 172.67.212.57, 2606:4700:3035::6815:356f, 2606:4700:3037::ac43:d439
Response IP 172.67.212.57
Found Yes
Hash b6b673fde50062518842238b4d8b8fe1008c572d8052426d1131150efbd5365d
SimHash 401cc54567c9

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • User-agent: * means all bots
  • Slow down aggressive crawlers
  • Allow these
Back to top