Log In Sign Up

americangirlfan.com
robots.txt

Robots Exclusion Standard data for americangirlfan.com

Resource Scan

Scan Details

Site Domain americangirlfan.com
Base Domain americangirlfan.com
Scan Status Ok
Last Scan2026-03-17T13:48:55+00:00
Next Scan 2026-04-16T13:48:55+00:00

Last Scan

Scanned2026-03-17T13:48:55+00:00
URL https://americangirlfan.com/robots.txt
Redirect https://www.americangirlfan.com/robots.txt
Redirect Domain www.americangirlfan.com
Redirect Base americangirlfan.com
Domain IPs 104.21.53.116, 172.67.212.159, 2606:4700:3033::ac43:d49f, 2606:4700:3037::6815:3574
Redirect IPs 104.21.53.116, 172.67.212.159, 2606:4700:3033::ac43:d49f, 2606:4700:3037::6815:3574
Response IP 172.67.212.159
Found Yes
Hash a41c0780f305885324d4c4412b1547a1c0499b3ad452a882590fcdc2f2546616
SimHash e48ace8145ba

Groups

lumen*

Rule Path
Disallow /

lumenapi*

Rule Path
Disallow /

dmcabot*

Rule Path
Disallow /

dmca*

Rule Path
Disallow /

legal*

Rule Path
Disallow /

chillingeffects*

Rule Path
Disallow /

copyscape*

Rule Path
Disallow /

plagiarismbot*

Rule Path
Disallow /

dmcachecker*

Rule Path
Disallow /

copyrightbot*

Rule Path
Disallow /

antipiracybot*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.americangirlfan.com/sitemap.xml
Back to top

Comments

  • =========================
  • Blokir semua varian Lumen & DMCA bots
  • =========================
  • =========================
  • Izinkan semua search engine resmi
  • =========================
Back to top