fanboy.id
robots.txt

Robots Exclusion Standard data for fanboy.id

Resource Scan

Scan Details

Site Domain fanboy.id
Base Domain fanboy.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-06T19:39:23+00:00
Next Scan 2026-01-05T19:39:23+00:00

Last Successful Scan

Scanned2025-11-07T02:01:21+00:00
URL https://fanboy.id/robots.txt
Domain IPs 104.21.38.60, 172.67.219.141, 2606:4700:3030::6815:263c, 2606:4700:3036::ac43:db8d
Response IP 104.21.38.60
Found Yes
Hash a3cc03e56ba46c1f7a77e7dedae67845fb3f95ffe44dcd04b0895022c6020d0f
SimHash 535cd370ce31

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-json/
Allow /wp-admin/admin-ajax.php

ahrefsbot
awariorssbot
awariosmartbot
barkrowler
blexbot
dataforseobot
dotbot
mj12bot
semrushbot
turnitinbot

Rule Path
Disallow /

mail.ru_bot
mauibot
linguee bot
imagesiftbot

Rule Path
Disallow /

chatgpt-user
openai
ccbot
gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://fanboy.id/docs-sitemap.xml
sitemap https://fanboy.id/sitemap_index.xml
sitemap https://fanboy.id/wikis/sosfomt/sitemap_index.xml
sitemap https://fanboy.id/wikis/sosawl/sitemap_index.xml

Comments

  • General
  • Bot gak guna bikin berat doang
  • Hemker
  • INAElectionObserverSOS