graphemics.net
robots.txt

Robots Exclusion Standard data for graphemics.net

Resource Scan

Scan Details

Site Domain graphemics.net
Base Domain graphemics.net
Scan Status Ok
Last Scan2026-03-07T10:26:46+00:00
Next Scan 2026-04-06T10:26:46+00:00

Last Scan

Scanned2026-03-07T10:26:46+00:00
URL https://graphemics.net/robots.txt
Domain IPs 104.21.91.82, 172.67.212.133
Response IP 172.67.212.133
Found Yes
Hash 76cdcf9036ac0d87c52e9cd296635c939783d8689e69bd021d45a3dbccd9c03e
SimHash 8c397d03d593

Groups

*
googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

gigabot

Rule Path
Disallow

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow

naverbot

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /feed/
Disallow /rss/
Disallow /*.avif$
Disallow /*.webp$
Disallow /feed/rss2
Disallow /feed/rss

Other Records

Field Value
sitemap https://graphemics.net/post-sitemap1.xml
sitemap https://graphemics.net/post-sitemap2.xml
sitemap https://graphemics.net/post-sitemap3.xml
sitemap https://graphemics.net/page-sitemap.xml
sitemap https://graphemics.net/llms-sitemap.xml