edvantagesolution.com
robots.txt

Robots Exclusion Standard data for edvantagesolution.com

Resource Scan

Scan Details

Site Domain edvantagesolution.com
Base Domain edvantagesolution.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-26T18:46:15+00:00
Next Scan 2024-08-24T18:46:15+00:00

Last Successful Scan

Scanned2023-04-10T17:47:46+00:00
URL https://edvantagesolution.com/robots.txt
Domain IPs 104.21.90.58, 172.67.153.137, 2606:4700:3031::6815:5a3a, 2606:4700:3034::ac43:9989
Response IP 104.21.90.58
Found Yes
Hash 635d7134e7edef3aebbe02075520776b361d8c1fd819e0e582c2ea9c86f9582f
SimHash 2961fe00c6c1

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-includes/

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole

googlebot-image

Rule Path Comment
Disallow /pdfs/ Block the /pdfs/directory.
Disallow *.pdf$ Block pdf files from all bots. Albeit non-standard, it works for major search engines.

googlebot-image

Rule Path Comment
Disallow /images/cats.jpg Block cats.jpg image for Googlebot specifically.

googlebot-image

Rule Path
Disallow /*.gif$

*

Rule Path
Disallow /calendar/
Disallow /junk/
Disallow /books/fiction/contemporary/

googlebot-image

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*.xls$

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://edvantagesolution.com/sitemap_index.xml

Comments

  • WP Import Export Rule

Warnings

  • `noindex` is not a known field.