Skip to content

C
crawler-py
Commit 705c1d32 authored by Charles刘佳佳's avatar Charles刘佳佳
Browse files
Options

fixed:redis只重推百科的队列

parent 05c6cc59
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
crawler.py
View file @ 705c1d32
...@@ -32,7 +32,8 @@ def GetCompany(types): ...@@ -32,7 +32,8 @@ def GetCompany(types):
# 重新放入采集队列 # 重新放入采集队列
def DoSpiderCompany(company, crawler_website): def DoSpiderCompany(company, crawler_website):
post_data = { post_data = {
"company_name": company "company_name": company,
"crawler_website": crawler_website
} }
json_data = json.dumps(post_data) json_data = json.dumps(post_data)
response = requests.post(cyaml.data[cyaml.data["env"]]["url"] + cyaml.data["php-api"]["respidercompany"], response = requests.post(cyaml.data[cyaml.data["env"]]["url"] + cyaml.data["php-api"]["respidercompany"],
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment