getfootballnewsgermany.com
robots.txt

Robots Exclusion Standard data for getfootballnewsgermany.com

Resource Scan

Scan Details

Site Domain getfootballnewsgermany.com
Base Domain getfootballnewsgermany.com
Scan Status Ok
Last Scan2024-11-13T21:38:56+00:00
Next Scan 2024-11-20T21:38:56+00:00

Last Scan

Scanned2024-11-13T21:38:56+00:00
URL https://getfootballnewsgermany.com/robots.txt
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Response IP 52.221.42.138
Found Yes
Hash b95a6c1506ef564b60c838fbf56fafb870d0015c237b198ce6c96c5fe49b6ac1
SimHash 6301aa62aea0

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow /comments
Disallow /category/*/*
Disallow */trackback
Disallow */comments
Disallow /*?*
Disallow /*?
Allow /wp-content/uploads
Allow /assets

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.getfootballnewsgermany.com/sitemap.xml
sitemap https://www.getfootballnewsgermany.com/sitemap.xml

Warnings

  • 3 invalid lines.