online-converting.com
robots.txt

Robots Exclusion Standard data for online-converting.com

Resource Scan

Scan Details

Site Domain online-converting.com
Base Domain online-converting.com
Scan Status Ok
Last Scan2024-10-04T13:31:09+00:00
Next Scan 2024-10-11T13:31:09+00:00

Last Scan

Scanned2024-10-04T13:31:09+00:00
URL https://online-converting.com/robots.txt
Domain IPs 192.99.167.73
Response IP 192.99.167.73
Found Yes
Hash c987e9c65c864df1cbc5a496fc8f80f9631a3fc0e8cfd6af8ad0f340d661fc53
SimHash 4b085f75963f

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /template.html
Disallow /wp-admin
Disallow /tag
Disallow */trackback/
Disallow */comments/
Disallow /?feed=
Disallow /?s=
Disallow /?p=
Disallow /converter.php
Disallow /document.php
Disallow /gps.php
Disallow /video.php
Disallow /autotrace.php
Disallow /video-to-avi.php
Disallow /vectorize.php
Disallow /succes-convert
Disallow /success
Disallow /success-convert
Disallow /error-convert
Disallow /error-upload
Disallow /file
Disallow /converter
Disallow /convert
Disallow /c/

Comments

  • Disallow: /wp-includes
  • Disallow: /wp-content

Warnings

  • `host` is not a known field.