figure-archive.net
robots.txt

Robots Exclusion Standard data for figure-archive.net

Resource Scan

Scan Details

Site Domain figure-archive.net
Base Domain figure-archive.net
Scan Status Ok
Last Scan2025-08-30T00:24:13+00:00
Next Scan 2025-09-29T00:24:13+00:00

Last Scan

Scanned2025-08-30T00:24:13+00:00
URL http://figure-archive.net/robots.txt
Domain IPs 108.181.199.147
Response IP 108.181.199.147
Found Yes
Hash dca20e2ecd7a7ecdbed92b3df0c7e7ee5feb3ac9d17d31a245d7210f2bf08c15
SimHash fd1d58a6c390

Groups

*

Rule Path
Disallow /Form4*
Disallow /item.aspx
Disallow /image.aspx
Disallow /user/
Disallow /bin/
Disallow /htm/
Disallow /html/
Disallow /admin/
Disallow /logs/
Disallow /User
Disallow /user
Disallow /*all_
Disallow /RSS
Disallow /recent
Disallow /search
Disallow /database

Other Records

Field Value
crawl-delay 480