academia-research.com
robots.txt
Robots Exclusion Standard data for academia-research.com
Resource Scan
Scan Details
Site Domain | academia-research.com |
Base Domain | academia-research.com |
Scan Status | Ok |
Last Scan | 2024-05-10T23:05:45+00:00 |
Next Scan | 2024-06-09T23:05:45+00:00 |
Last Scan
Scanned | 2024-05-10T23:05:45+00:00 |
URL | https://academia-research.com/robots.txt |
Redirect | https://www.academia-research.com/robots.txt |
Redirect Domain | www.academia-research.com |
Redirect Base | academia-research.com |
Domain IPs | 104.21.27.55, 172.67.141.118, 2606:4700:3030::ac43:8d76, 2606:4700:3032::6815:1b37 |
Redirect IPs | 104.21.27.55, 172.67.141.118, 2606:4700:3030::ac43:8d76, 2606:4700:3032::6815:1b37 |
Response IP | 104.21.27.55 |
Found | Yes |
Hash | 0164e81990c4a05a876106fdd9c9b7bed6d31378023ee4312b72fa79ea0365be |
SimHash | be50017ae483 |
Groups
*
Rule | Path |
---|---|
Disallow | /*author |
Disallow | /2017/ |
Disallow | /2016/ |
Disallow | /2015/ |
Disallow | /2014/ |
Disallow | /feed/ |
Disallow | /add-new-post/ |
Disallow | /wp-content/ |
Disallow | /*?replytocom= |
Disallow | /*? |
Disallow | /*attachment |
Disallow | /filecache/ |
Allow | /wp-includes/css/ |
Allow | /wp-includes/js/ |
Allow | /wp-includes/images/ |
Allow | /wp-content/*.css |
Allow | /wp-content/*.js |
Allow | /wp-content/*.png |
Allow | /wp-content/*.jpg |
Allow | /wp-content/*.jpeg |
Allow | /wp-content/*.gif |
Allow | /wp-content/*.svg |
Other Records
Field | Value |
---|---|
sitemap | https://www.academia-research.com/sitemap.xml |
Warnings
- `host` is not a known field.