Screaming Frog – How to Save & Load a Custom Crawl Coniguration

Handy if you have loads of custom extractions set up etc.

  • Saving Custom Config File:

Under the Configuration Menu – go to – Profiles>Save As

  • Importing The Custom Config File

Configuration > Profiles > Load…

SF custom Config File Import
  • Save as default

    Also worth knowing – if you use a similar setup each time you run Screaming Frog – let’s say, you exclude anything with “account” or “customer” in the URL, you can save your setup/config as default:

Which can be a nice time saver too!

I pretty much always add the following to the excludes ‘file’, so it’s easier to keep it in the default setup:

^https?://[^/]+/customer/account/.*
^https?://[^/]+/checkout/cart/.*

^.\?.

.js$

.css$

Leave a comment