爬取昵图网 设计/摄影图库 图片

LEOIRON

新手照猫画虎写了一个爬昵图网图库照片的小爬虫，爬下来有水印

52PJ

[Python] 纯文本查看 复制代码

import requests
from lxml import etree
import os

url1 = "http://www.nipic.com/photo/shengwu/yulei/index.html"#目标设计/摄影图库地址
data1 = requests.get(url1).text
s1 = etree.HTML(data1)
pics_href = s1.xpath("/html/body/div[@class='new-layout-width mbt-area clearfix layout-width']/div[@class='fl new-search-main']/div[@class='new-search-result overflow-hidden']/ul/li/a/@href")

i = 1
for pic_href in pics_href:
    try:
        url2 = pic_href
        data2 = requests.get(url2).text
        s2 = etree.HTML(data2)
        pic_list = s2.xpath("//*[@id='J_worksImg']/@src")
        pic_url = pic_list[0]
        root = "f://Pyspider//pics//"#可更改为自己的路径
        path = root + pic_url.split('/')[-1]
        if not os.path.exists(root):
            os.mkdir(root)
        if not os.path.exists(path):
            r = requests.get(pic_url)
            with open(path,'wb') as f:
                f.write(r.content)
                f.close()
                print('第{}张图片保存成功'.format(i))
                i += 1
        else:
            print('此图片已存在')
    except:
        print('图片地址异常')

糊涂虫晓晓

经测试，全是图片地址异常

LEOIRON

糊涂虫晓晓 发表于 2021-3-24 20:24
经测试，全是图片地址异常

看了看是copy时最后的代码缩进错了😂，改了之后应该可以了，同时注意图库地址正确

糊涂虫晓晓

试试这个代码，把你的代码稍微修改了一下，不报错了，只能下载第一页，没有翻页功能。

[Python] 纯文本查看 复制代码

import requests
from lxml import html
import os

url1 = "https://www.nipic.com/design/ziran/fengguang/index.html"  # 目标设计/摄影图库地址
data1 = requests.get(url1).text
etree=html.etree
s1 = etree.HTML(data1)
pics_href = s1.xpath(
	"/html/body/div[@class='new-layout-width mbt-area clearfix layout-width']/div[@class='fl new-search-main']/div[@class='new-search-result overflow-hidden']/ul/li/a/@href")
i = 1
for pic_href in pics_href:
	try:
		url2 = "https:"+pic_href
		data2 = requests.get(url2).text
		s2 = etree.HTML(data2)
		pic_list = s2.xpath("//*[@id='J_worksImg']/@src")
		pic_url = pic_list[0]
		root = "f:/Pyspider/pics/"  # 可更改为自己的路径
		path = root + pic_url.split('/')[-1]
		if not os.path.exists(root):
			os.mkdir(root)
		if not os.path.exists(path):
			r = requests.get("https:"+pic_url)
			with open(path, 'wb') as f:
				f.write(r.content)
				f.close()
				print('第{}张图片保存成功'.format(i))
				i += 1
		else:
			print('此图片已存在')
	except:
		continue