Log In Sign Up

weekday.technology
robots.txt

Robots Exclusion Standard data for weekday.technology

Resource Scan

Scan Details

Site Domain weekday.technology
Base Domain weekday.technology
Scan Status Ok
Last Scan2025-11-24T01:25:31+00:00
Next Scan 2025-12-24T01:25:31+00:00

Last Scan

Scanned2025-11-24T01:25:31+00:00
URL https://weekday.technology/robots.txt
Redirect https://www.weekday.works/robots.txt
Redirect Domain www.weekday.works
Redirect Base weekday.works
Domain IPs 199.36.158.100
Redirect IPs 18.155.68.106, 18.155.68.22, 18.155.68.57, 18.155.68.81, 2600:9000:23d2:1800:c:bef7:f0c0:93a1, 2600:9000:23d2:4600:c:bef7:f0c0:93a1, 2600:9000:23d2:4e00:c:bef7:f0c0:93a1, 2600:9000:23d2:7000:c:bef7:f0c0:93a1, 2600:9000:23d2:7600:c:bef7:f0c0:93a1, 2600:9000:23d2:7e00:c:bef7:f0c0:93a1, 2600:9000:23d2:8800:c:bef7:f0c0:93a1, 2600:9000:23d2:a00:c:bef7:f0c0:93a1
Response IP 18.155.68.57
Found Yes
Hash 52b228f706510af8eb8ff5bd6881a231107a54de42167ab3cee804a523b44f69
SimHash 6d50ba73c790

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*
Disallow /

gptbot

Rule Path
Allow /
Disallow /public/

Other Records

Field Value
crawl-delay 1

perplexitybot

Rule Path
Allow /
Disallow /public/

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /
Disallow /public/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /
Disallow /public/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://weekday.works/sitemap.xml
Back to top

Comments

  • Default rules
  • Allow OpenAI (GPTBot)
  • Allow Perplexity
  • Allow Bing
  • Allow Googlebot
Back to top

Warnings

  • `host` is not a known field.
Back to top