MENU
You want that some of your Web pages should not be crawled. Which one of the following options will you use to accomplish the task?
Suggested Answer: C
Get Premium GPEN Questions
as Interactive Web-Based Practice Test or PDF
Real Exam Format
Detailed Explanations
Instant Access
Get Your Practice Test
12 comments · newest first
BE
Becky
11 months ago
I heard about private.txt, but is that even a real thing?
VO
Von
11 months ago
Wait, can SSL really stop crawling? Sounds off.
TI
Tiffiny
12 months ago
I thought the NO Crawl tag was a thing?
SH
Sharan
12 months ago
Totally agree, robots.txt is the way to go!
TA
Tamie
12 months ago
You should use the robots.txt file for that.
LE
Lemuel
1 year ago
I’m confused about the private.txt file. I don’t recall studying that; it seems like it might be a trick option.
KA
Kaitlyn
1 year ago
I feel like the HTML NO Crawl tag option is not something I've seen before. Was that even a real thing?
JE
Jesusita
1 year ago
I think I remember something about using a robots.txt file to block crawlers, but I'm not entirely sure if that's the right answer here.
HA
Harrison
1 year ago
I practiced a similar question where we had to restrict access to certain pages, and I think it was definitely about the robots.txt file.
JA
Janessa
1 year ago
I remember learning about Phantom in class, and I believe the default search engine is the Phantom-specific one. I'll select option B.
DY
Dyan
1 year ago
Okay, let me think this through step-by-step. I want to make sure I understand the process fully.
GE
Geraldo
1 year ago
I feel pretty confident about this one. The term "intra-articular" clearly refers to the joint space, so the correct answer is A.