netfira.com
robots.txt

Robots Exclusion Standard data for netfira.com

Resource Scan

Scan Details

Site Domain netfira.com
Base Domain netfira.com
Scan Status Ok
Last Scan2024-09-08T04:19:50+00:00
Next Scan 2024-10-08T04:19:50+00:00

Last Scan

Scanned2024-09-08T04:19:50+00:00
URL https://netfira.com/robots.txt
Domain IPs 192.0.78.128, 192.0.78.229
Response IP 192.0.78.229
Found Yes
Hash 8ff0283b682bf79b03f5321d16998ead1f9507c7ad8e6401a5fe0731e510b7a0
SimHash 3a07c853c8b8

Groups

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Allow /page-sitemap.xml
Allow /post-sitemap.xml

adsbot

Rule Path Comment
Disallow / -
Disallow /*?* This blocks any URL that contains a question mark, which could prevent duplication issues.
Disallow /*.pdf$ This blocks search engines from indexing PDF files if any.

Other Records

Field Value
sitemap https://netfira.com/sitemap_index.xml

Comments

  • XML Sitemaps
  • General Directives
  • Allow Directives for Specific Sitemaps
  • Block AdsBot Completely
  • Additional Recommendations
  • END