mems.wtf
robots.txt

Robots Exclusion Standard data for mems.wtf

Resource Scan

Scan Details

Site Domain mems.wtf
Base Domain mems.wtf
Scan Status Ok
Last Scan2025-11-03T00:50:10+00:00
Next Scan 2025-12-03T00:50:10+00:00

Last Scan

Scanned2025-11-03T00:50:10+00:00
URL https://mems.wtf/robots.txt
Redirect https://www.mems.wtf/robots.txt
Redirect Domain www.mems.wtf
Redirect Base mems.wtf
Domain IPs 216.150.1.1
Redirect IPs 216.150.1.65, 216.150.16.65
Response IP 216.150.1.129
Found Yes
Hash 3abd74fb3026b1db80f7478f5936f721ef6fd8b1b681ca3b010dafa46241aaac
SimHash 6d0c8e11e4a1

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /_next/
Disallow /admin/
Disallow /.well-known/
Allow /favicon.ico
Allow /sitemap.xml
Allow /robots.txt

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://lolcoin.com/sitemap.xml

Comments

  • Block access to sensitive files
  • Allow important files
  • Sitemap location
  • Crawl delay (optional - adjust based on your server capacity)