首页 > 编程知识 正文

站酷海洛网图片爬虫

时间:2023-05-05 01:59:19 阅读:244976 作者:3942

# -*- coding:utf-8 -*-import osimport requestsimport urllibfrom pyquery import PyQueryimport uuidfrom pypinyin import pinyinimport unicodedataheaders = { "User-Agent": "Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome" "/75.0.3770.142 Safari/537.36"}def href_url_download(): # 1.填写要爬取关键词的list.txt keyword_list = open("list.txt", 'r', encoding='utf-8') lines = keyword_list.readlines() keyword_list.close() for keyword in lines: keyword = keyword.strip() print(keyword) # ------------------------汉字转化成拼音------------------------------------- # word = pinyin(keyword) # pin_yin = "".join(str(i[0]) for i in word) # print(pin_yin) # res = unicodedata.normalize('NFKD', pin_yin).encode('ascii', 'ignore').decode("ascii")

版权声明:该文观点仅代表作者本人。处理文章:请发送邮件至 三1五14八八95#扣扣.com 举报,一经查实,本站将立刻删除。