pdffiller.com
robots.txt
Robots Exclusion Standard data for pdffiller.com
Resource Scan
Scan Details
Site Domain | pdffiller.com |
Base Domain | pdffiller.com |
Scan Status | Ok |
Last Scan | 2025-07-07T12:19:06+00:00 |
Next Scan | 2025-07-14T12:19:06+00:00 |
Last Scan
Scanned | 2025-07-07T12:19:06+00:00 |
URL | https://pdffiller.com/robots.txt |
Domain IPs | 23.20.6.153, 44.208.251.190, 54.174.88.98 |
Response IP | 23.20.6.153 |
Found | Yes |
Hash | 9c4f82051d479b9e3daed24a5b39506cd8ad351c959faba7e03ec10ace13f3b6 |
SimHash | 729f5953cf50 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/link_to_fill/* |
Disallow | /api_v3/visit/ |
Disallow | /*/uploader/* |
Disallow | /flash/uploader.swf |
Disallow | /flash/data/up.php |
Disallow | /*/fillable-pdf-forms-search-engine.htm |
Disallow | /jsfiller-desk* |
Disallow | /jsfiller-mob* |
Disallow | /en/official/* |
Disallow | /*/shareViaLink/* |
Disallow | /*?ref=* |
Disallow | /*?pseudo_id=* |
Disallow | /*?gclid=* |
Disallow | /*?keyword=* |
Disallow | /*?forms_cache=* |
Disallow | /*?msclkid=* |
Disallow | */mpages/* |
Disallow | */texteditor/* |
Disallow | */login/* |
Disallow | */helpers/* |
Disallow | */spreadsheet/* |
Disallow | */data$ |
Disallow | */cookies$ |
Disallow | */terms$ |
Disallow | */migrations$ |
Disallow | */init$ |
Disallow | */params$ |
Disallow | */errorCorrectLevel$ |
Disallow | */mtrcs/* |
adidxbot
Rule | Path |
---|---|
Disallow | /*?ref=* |
Disallow | /en/captcha.htm |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
amazonbot
claudebot
ai agent anthropic-ai
ai agent claude-web
applebot
applebot-extended
facebookbot
google-extended
googleother
googleother-image
googleother-video
meta-externalfetcher
meta-externalagent
facebookexternalhit
chatgpt-user
oai-searchbot
gptbot
perplexitybot
youbot
bytespider
ccbot
petalbot
timpibot
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_catalog_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_alphabetical_catalog_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_category_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_form_irs_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_form_localization_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_form_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_form_seo_test_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_cdoctype_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_cfiletype_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_csign_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_document_verb_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_synonyms_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_apipages_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_b2b_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_integrations_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_competitors_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_functionality_localization_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_functionality_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_general_index.xml |
sitemap | https://www.pdffiller.com/new-sitemaps/sitemap_guides_index.xml |