Log In Sign Up

weekday.technology
robots.txt

Robots Exclusion Standard data for weekday.technology

Resource Scan

Scan Details

Site Domain weekday.technology
Base Domain weekday.technology
Scan Status Ok
Last Scan2025-09-24T19:43:57+00:00
Next Scan 2025-10-24T19:43:57+00:00

Last Scan

Scanned2025-09-24T19:43:57+00:00
URL https://weekday.technology/robots.txt
Redirect https://www.weekday.works/robots.txt
Redirect Domain www.weekday.works
Redirect Base weekday.works
Domain IPs 199.36.158.100
Redirect IPs 18.155.68.106, 18.155.68.22, 18.155.68.57, 18.155.68.81, 2600:9000:23d2:1e00:c:bef7:f0c0:93a1, 2600:9000:23d2:3400:c:bef7:f0c0:93a1, 2600:9000:23d2:6a00:c:bef7:f0c0:93a1, 2600:9000:23d2:6c00:c:bef7:f0c0:93a1, 2600:9000:23d2:a800:c:bef7:f0c0:93a1, 2600:9000:23d2:c000:c:bef7:f0c0:93a1, 2600:9000:23d2:d600:c:bef7:f0c0:93a1, 2600:9000:23d2:d800:c:bef7:f0c0:93a1
Response IP 18.155.68.81
Found Yes
Hash 6a88a3d20dd1b78b4300555036f3752ad48188428f156d988cc0ad8f5351e39f
SimHash 4c509b51e5b0

Groups

*

Rule Path
Allow /*.js*
Allow /*.css*

gptbot

Rule Path
Allow /
Disallow /public/

perplexitybot

Rule Path
Allow /
Disallow /public/

googlebot

Rule Path
Allow /
Disallow /public/

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://weekday.works/sitemap.xml
Back to top

Comments

  • Host
  • Sitemap
  • Allow css and js load
  • Allow OpenAI (GPTBot)
  • Allow Perplexity (adjust if actual user-agent is different)
  • Allow Googlebot
  • Disallow all other user agents
Back to top

Warnings

  • `host` is not a known field.
Back to top