conferencesthatwork.com
robots.txt

Robots Exclusion Standard data for conferencesthatwork.com

Resource Scan

Scan Details

Site Domain conferencesthatwork.com
Base Domain conferencesthatwork.com
Scan Status Ok
Last Scan2025-12-10T03:08:39+00:00
Next Scan 2026-01-09T03:08:39+00:00

Last Scan

Scanned2025-12-10T03:08:39+00:00
URL https://conferencesthatwork.com/robots.txt
Redirect https://www.conferencesthatwork.com/robots.txt
Redirect Domain www.conferencesthatwork.com
Redirect Base conferencesthatwork.com
Domain IPs 104.21.46.78, 172.67.136.106, 2606:4700:3030::ac43:886a, 2606:4700:3035::6815:2e4e
Redirect IPs 104.21.46.78, 172.67.136.106, 2606:4700:3030::ac43:886a, 2606:4700:3035::6815:2e4e
Response IP 104.21.46.78
Found Yes
Hash 6accbff39855ed3f6db84b1bb6986d4175092da29e67aee18997d52897ba6639
SimHash 8c1d4b92e890

Groups

bufferlinkpreviewbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

tweetedtimes

Rule Path
Disallow /

voltron

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10.0

Other Records

Field Value
sitemap https://www.conferencesthatwork.com/sitemap.xml

Warnings

  • 2 invalid lines.