{"id":62863,"date":"2018-08-31T09:01:27","date_gmt":"2018-08-31T00:01:27","guid":{"rendered":"https:\/\/www.softantenna.com\/wp\/?p=62863"},"modified":"2018-08-31T09:01:27","modified_gmt":"2018-08-31T00:01:27","slug":"a-guide-to-preventing-webscraping","status":"publish","type":"post","link":"https:\/\/softantenna.com\/blog\/a-guide-to-preventing-webscraping\/","title":{"rendered":"A guide to preventing Webscraping - Web\u30da\u30fc\u30b8\u306e\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3092\u9632\u3050\u305f\u3081\u306e\u7d71\u5408\u30ac\u30a4\u30c9"},"content":{"rendered":"<p><img decoding=\"async\" style=\"display:block; margin-left:auto; margin-right:auto;\" src=\"https:\/\/softantenna.com\/blog\/wp-content\/uploads\/2018\/08\/pexels-photo-67112-1.jpeg\" alt=\"Pexels photo 67112\" title=\"pexels-photo-67112.jpeg\" border=\"0\" width=\"1280\" height=\"851\" \/><\/p>\n<p>\u300c\u30a6\u30a7\u30d6\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u300d\u3068\u306f\u3001\u30a6\u30a7\u30d6\u30b5\u30a4\u30c8\u304b\u3089\u304b\u3089\u60c5\u5831\u3092\u62bd\u51fa\u3059\u308b\u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u30fc\u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u6280\u8853\u306e\u3053\u3068\u3002<\/p>\n<p>\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u4e0a\u306b\u5b58\u5728\u3059\u308b\u60c5\u5831\u304b\u3089\u5fc5\u8981\u306a\u30c7\u30fc\u30bf\u3092\u53d6\u308a\u51fa\u3059\u3053\u3068\u304c\u3067\u304d\u308b\u4fbf\u5229\u306a\u6280\u8853\u3067\u3059\u304c\u3001\u60c5\u5831\u3092\u63d0\u4f9b\u3059\u308b\u5074\u304b\u3089\u3059\u308b\u3068\u3001\u5229\u7528\u3055\u308c\u305f\u304f\u306a\u3044\u5834\u5408\u3082\u3042\u308b\u304b\u3082\u3057\u308c\u307e\u305b\u3093\u3002<\/p>\n<p>\u4eca\u56de\u7d39\u4ecb\u3059\u308b\u300c<a href=\"https:\/\/github.com\/JonasCz\/How-To-Prevent-Scraping\">A guide to preventing Webscraping<\/a>\u300d\u306f\u3001\u3053\u306e\u30a6\u30a7\u30d6\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3092\u9632\u3050\u305f\u3081\u306e\u3055\u307e\u3056\u307e\u306a\u65b9\u6cd5\u3092\u89e3\u8aac\u3059\u308b\u82f1\u8a9e\u306e\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u3067\u3059\u3002<\/p>\n<p>\u958b\u767a\u8005JonasCz\u6c0f\u306b\u3088\u3063\u3066StackOverflow\u306b\u6295\u7a3f\u3055\u308c\u305f\u56de\u7b54\u306e\u62e1\u5f35\u7248\u3068\u3055\u308c\u3001CC-BY-SA 3.0\u306e\u3082\u3068\u81ea\u7531\u306b\u5909\u66f4\u3001\u30ea\u30df\u30c3\u30af\u30b9\u3001\u5171\u6709\u3057\u3066\u3088\u3044\u3068\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<h2>\u30a6\u30a7\u30d6\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3092\u9632\u3050\u6280\u8853<\/h2>\n<p>\u540c\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306f\u3001\u30a6\u30a7\u30d6\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3092\u9632\u3050\u305f\u3081\u306b\u306f\u3001\u5b9f\u969b\u306e\u30e6\u30fc\u30b6\u30fc\u3084\u30b5\u30fc\u30c1\u30a8\u30f3\u30b8\u30f3\u304b\u3089\u306e\u304b\u3089\u306e\u30a2\u30af\u30bb\u30b9\u3092\u5bb9\u6613\u306b\u4fdd\u3063\u305f\u307e\u307e\u3001\u30b9\u30af\u30ea\u30d7\u30c8\u3084\u30c4\u30fc\u30eb\u306b\u3088\u308b\u30c7\u30fc\u30bf\u306e\u53d6\u5f97\u3092\u56f0\u96e3\u306a\u5fc5\u8981\u304c\u3042\u308b\u3068\u8aac\u660e\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u3053\u306e\u4e0a\u3067\u5177\u4f53\u7684\u306b\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3092\u9632\u3050\u305f\u3081\u306b\u4ee5\u4e0b\u306e\u3088\u3046\u306a\u624b\u6cd5\u3092\u30ea\u30b9\u30c8\u30a2\u30c3\u30d7\u3057\u3066\u3044\u307e\u3059:<\/p>\n<ul>\n<li>\u30ed\u30b0\u3068\u30c8\u30e9\u30d5\u30a3\u30c3\u30af\u306e\u30d1\u30bf\u30fc\u30f3\u3092\u76e3\u8996\u3059\u308b\u3002 \u7570\u5e38\u306a\u30a2\u30af\u30c6\u30a3\u30d3\u30c6\u30a3\u306f\u30a2\u30af\u30bb\u30b9\u3092\u5236\u9650\u3059\u308b\u3002<\/li>\n<li>\u767b\u9332\u3068\u30ed\u30b0\u30a4\u30f3\u304c\u5fc5\u8981\u306a\u30b5\u30a4\u30c8\u306b\u3059\u308b\u3002<\/li>\n<li>\u30af\u30e9\u30a6\u30c9\u30db\u30b9\u30c6\u30a3\u30f3\u30b0\u3084\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u30b5\u30fc\u30d3\u30b9\u306eIP\u30a2\u30c9\u30ec\u30b9\u304b\u3089\u306e\u30a2\u30af\u30bb\u30b9\u3092\u30d6\u30ed\u30c3\u30af\u3059\u308b\u3002<\/li>\n<li>\u30a8\u30e9\u30fc\u30e1\u30c3\u30bb\u30fc\u30b8\u3092\u51fa\u529b\u3057\u306a\u3044\u3002<\/li>\n<li>Captchas\u3092\u4f7f\u7528\u3059\u308b\u3002<\/li>\n<li>\u30c6\u30ad\u30b9\u30c8\u3092\u753b\u50cf\u3068\u3057\u3066\u63d0\u4f9b\u3059\u308b\u3002<\/li>\n<li>\u5b8c\u5168\u306a\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u3092\u63d0\u4f9b\u3057\u306a\u3044<\/li>\n<li>API\u3092\u5229\u7528\u3055\u305b\u306a\u3044<\/li>\n<\/ul>\n<p><img decoding=\"async\" style=\"display:block; margin-left:auto; margin-right:auto;\" src=\"https:\/\/softantenna.com\/blog\/wp-content\/uploads\/2018\/08\/pexels-photo-706500.jpeg\" alt=\"Pexels photo 706500\" title=\"pexels-photo-706500.jpeg\" border=\"0\" width=\"1280\" height=\"853\" \/><\/p>\n<p>\u307e\u305fHTML\u30d1\u30fc\u30b5\u30fc\u3068\u30b9\u30af\u30ec\u30a4\u30d1\u30fc\u3092\u6291\u6b62\u3059\u308b\u65b9\u6cd5\u3068\u3057\u3066\u4ee5\u4e0b\u306e\u65b9\u6cd5\u3092\u30ea\u30b9\u30c8\u30a2\u30c3\u30d7\u3057\u3066\u3044\u307e\u3059:<\/p>\n<ul>\n<li>HTML\u3092\u983b\u7e41\u306b\u5909\u66f4\u3059\u308b\u3002<\/li>\n<li>\u30e6\u30fc\u30b6\u30fc\u306e\u4f4d\u7f6e\u60c5\u5831\u306b\u57fa\u3065\u304dHTML\u3092\u5909\u66f4\u3059\u308b\u3002<\/li>\n<li>\u983b\u7e41\u306bHTML\u3092\u5909\u66f4\u3059\u308b\u3002<\/li>\n<li>\u507d\u306e\u30c7\u30fc\u30bf\u3092\u30da\u30fc\u30b8\u306b\u8ffd\u52a0\u3059\u308b\u3002<\/li>\n<li>\u30b9\u30af\u30ec\u30a4\u30d1\u30fc\u3092\u691c\u51fa\u3057\u305f\u5834\u5408\u507d\u306e\u30c7\u30fc\u30bf\u3092\u63d0\u4f9b\u3059\u308b\u3002<\/li>\n<li>User Agent\u304c\u7a7a\u3084\u9593\u9055\u3063\u3066\u3044\u308b\u5834\u5408\u30ea\u30af\u30a8\u30b9\u30c8\u3092\u53d7\u3051\u4ed8\u3051\u306a\u3044\u3002<\/li>\n<li>User Agent\u304c\u30b9\u30af\u30ec\u30a4\u30d1\u30fc\u306e\u3082\u306e\u306e\u5a46\u30ea\u30af\u30a8\u30b9\u30c8\u3092\u53d7\u3051\u4ed8\u3051\u306a\u3044\u3002<\/li>\n<li>\u30ea\u30d5\u30a1\u30e9\u30d8\u30c3\u30c0\u3092\u30c1\u30a7\u30c3\u30af\u3059\u308b\u3002<\/li>\n<li>CSS\u3084\u753b\u50cf\u3092\u30ea\u30af\u30a8\u30b9\u30c8\u3057\u306a\u3044\u5834\u5408\u672c\u5f53\u306e\u30d6\u30e9\u30a6\u30b6\u3067\u306f\u306a\u3044\u3002<\/li>\n<li>Cookie\u3092\u4f7f\u7528\u3059\u308b<\/li>\n<li>JavaScript\u3068Ajax\u3092\u4f7f\u3063\u3066\u30b3\u30f3\u30c6\u30f3\u30c4\u3092\u30ed\u30fc\u30c9\u3059\u308b\u3002<\/li>\n<li>\u30de\u30fc\u30af\u30a2\u30c3\u30d7\u306a\u3069\u3092\u96e3\u8aad\u5316\u3059\u308b\u3002<\/li>\n<\/ul>\n<p>\u305d\u308c\u305e\u308c\u306e\u9805\u76ee\u306e\u5177\u4f53\u7684\u306a\u65b9\u6cd5\u306f\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306b\u63b2\u8f09\u3055\u308c\u3066\u3044\u307e\u3059\u306e\u3067\u3054\u78ba\u8a8d\u304f\u3060\u3055\u3044\u3002\u306a\u304a\u305d\u306e\u4ed6\u6cd5\u7684\u306a\u624b\u6bb5\u3092\u691c\u8a0e\u3059\u308b\u306a\u3069\u3001\u975e\u6280\u8853\u7684\u306a\u65b9\u6cd5\u3082\u63b2\u8f09\u3055\u308c\u3066\u3044\u307e\u3059\u3002<\/p>\n<p>\u30a6\u30a7\u30d6\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u3092\u306a\u3093\u3068\u304b\u3057\u3066\u9632\u304e\u305f\u3044\u65b9\u306b\u3068\u3063\u3066\u306f\u53c2\u8003\u306b\u306a\u308b\u60c5\u5831\u3068\u3044\u3048\u305d\u3046\u3067\u3059\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u300c\u30a6\u30a7\u30d6\u30b9\u30af\u30ec\u30a4\u30d4\u30f3\u30b0\u300d\u3068\u306f\u3001\u30a6\u30a7\u30d6\u30b5\u30a4\u30c8\u304b\u3089\u304b\u3089\u60c5\u5831\u3092\u62bd\u51fa\u3059\u308b\u30b3\u30f3\u30d4\u30e5\u30fc\u30bf\u30fc\u30bd\u30d5\u30c8\u30a6\u30a7\u30a2\u6280\u8853\u306e\u3053\u3068\u3002 \u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u4e0a\u306b\u5b58\u5728\u3059\u308b\u60c5\u5831\u304b\u3089\u5fc5\u8981\u306a\u30c7\u30fc\u30bf\u3092\u53d6\u308a\u51fa\u3059\u3053\u3068\u304c\u3067\u304d\u308b\u4fbf\u5229\u306a\u6280\u8853\u3067\u3059\u304c\u3001\u60c5\u5831\u3092\u63d0\u4f9b\u3059\u308b\u5074\u304b\u3089\u3059\u308b\u3068\u3001\u5229 [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":62941,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"swell_btn_cv_data":"","footnotes":""},"categories":[66],"tags":[4163,575],"class_list":["post-62863","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-webservice","tag-scraping","tag-web"],"_links":{"self":[{"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/posts\/62863","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/comments?post=62863"}],"version-history":[{"count":0,"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/posts\/62863\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/media\/62941"}],"wp:attachment":[{"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/media?parent=62863"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/categories?post=62863"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/softantenna.com\/blog\/wp-json\/wp\/v2\/tags?post=62863"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}