rolia.net
robots.txt

Robots Exclusion Standard data for rolia.net

Resource Scan

Scan Details

Site Domain rolia.net
Base Domain rolia.net
Scan Status Ok
Last Scan2024-07-02T13:30:27+00:00
Next Scan 2024-07-09T13:30:27+00:00

Last Scan

Scanned2024-07-02T13:30:27+00:00
URL https://rolia.net/robots.txt
Redirect https://www.rolia.net/robots.txt
Redirect Domain www.rolia.net
Redirect Base rolia.net
Domain IPs 162.255.84.229, 2607:f1c0:1800:8199::1
Redirect IPs 162.255.84.229, 2607:f1c0:1800:8199::1
Response IP 162.255.84.229
Found Yes
Hash 4e1624584fa22ee4a8663ca886dfd81f678bee49dbf4821c28b75d91a5d7ff09
SimHash 6915dc75e053

Groups

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /css/
Disallow /audio/
Disallow /crontab/
Disallow /doc/
Disallow /etk/
Disallow /fonts/
Disallow /grp/
Disallow /idol/
Disallow /js/
Disallow /lib/
Disallow /lib.full/
Disallow /mem/
Disallow /m/
Disallow /script/
Disallow /upImg/
Disallow /uiV2/

googlebot-image

Rule Path
Disallow /upImg/
Disallow /uiV2/

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

msnbot
slurp

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.rolia.net/_sitemaps/sitemap_index.xml

Comments

  • Crawl-delay: 10
  • Crawl-delay: 5
  • User-agent: googlebot
  • Crawl-delay: 2