• White Hat SEO

  Screaming Frog Help – Custom Search Config.

  Posted by bbmomma2 on April 29, 2024 at 12:13 pm

  New to screaming frog tool – I want to crawl our whole site for links/text for "(?i) blackboard" and remove the crawl from returning results in our .top-green-bar. However, when I go to content area < exclude classes and enter "top-green-bar" I'm still returning results for that area. The custom search is configured to include "Page Text". What have I missed?

  bbmomma2 replied 2 weeks, 2 days ago 2 Members · 1 Reply
• 1 Reply

• 

  Dazzle___

  Guest

  April 29, 2024 at 2:20 pm

  I think you should try the following:

  1. In the “Configuration” menu, go to “Spider” > “Exclusions”.
  2. Click “Add” under the “Exclude Elements” section.
  3. Select “CSS Selector” and enter the selector “.top-green-bar” (make sure to include the period).
  4. Click “OK” to save the exclusion rule.

  I think this should prevent screaming frog from including any text or links found within elements that have the “top-green-bar” CSS class assigned to them.

Log In to Reply