rareskills.io
robots.txt

Robots Exclusion Standard data for rareskills.io

Resource Scan

Scan Details

Site Domain rareskills.io
Base Domain rareskills.io
Scan Status Ok
Last Scan2025-06-07T00:34:20+00:00
Next Scan 2025-07-07T00:34:20+00:00

Last Scan

Scanned2025-06-07T00:34:20+00:00
URL https://rareskills.io/robots.txt
Redirect https://www.rareskills.io/robots.txt
Redirect Domain www.rareskills.io
Redirect Base rareskills.io
Domain IPs 104.21.40.187, 172.67.156.76, 2606:4700:3031::ac43:9c4c, 2606:4700:3034::6815:28bb
Redirect IPs 104.21.40.187, 172.67.156.76, 2606:4700:3031::ac43:9c4c, 2606:4700:3034::6815:28bb
Response IP 104.21.40.187
Found Yes
Hash aa823c66da8428df234a35323aa11bdb0dbc88d349545fa8a631bcc7cd09216f
SimHash 680088022bb2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow */feed*
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.rareskills.io/sitemap_index.xml