pumping items out to csv file using python scrapy - issue with how outputted in csv file -



pumping items out to csv file using python scrapy - issue with how outputted in csv file -

having issue want add together output csv file not start below field name placed in next row in sequence opposed placing @ row 2 when populating playermins item in csv file. can please tell me code going wrong?? here is:

class espnspider3(basespider): name = "espn3.org" allowed_domains = ["espn3.org"] start_urls = [ "http://scores.espn.go.com/nba/boxscore?gameid=310502004" ] def parse(self, response): hxs = htmlxpathselector(response) item = espnitem() rows = [] playername = [] playermins = [] # player names p_names = hxs.select('(//table[@class="mod-data"][1]/tbody/tr)//a/text()').extract() p_name in p_names: print p_name yield espnitem(playername=p_name) # minutes p_minutes = hxs.select('(//table[@class="mod-data"][1]/tbody/tr)/td[2]').extract() p_minute in p_minutes: print p_minute yield espnitem(playermins=p_minute)

was able solve issue, after much googling , rtfm: trying utilize itemexporter in scrapy

here working code:

def parse(self, response): hxs = htmlxpathselector(response) player_names = hxs.select('(//table[@class="mod-data"][1]/tbody/tr)') p_name in player_names: l = xpathitemloader(item=espnitem(), selector=p_name ) l.add_xpath('playername', 'td[1]/a/text()') l.add_xpath('playermins', 'td[2]') yield l.load_item()

python scrapy

Comments

Post a Comment

Popular posts from this blog

iphone - Dismissing a UIAlertView -

iphone - Dismissing a UIAlertView - i set in app purchase app, , when user taps button, purchase started. basically, tap button, , depending on speed on net connection, waiting 10 seconds until new alert view comes asking if purchase product. user tap button multiple times since nil came up, , multiple purchase alert views come up. additionally, maybe seen user app bug. in end, problem. i want alert view come spinning wheel says "loading..." when users taps purchase button. problem is, how dismiss when new alert view comes asking user if want purchase product? if ([uialertview alloc] says: @"whatever apple's alert view says") { //dismiss "loading..." alert view here } i uncertainty work, input appreciated. thanks! you need have access alertview. can this. create alertview instance var in app delegate , when want show loading initialize instance var assign property , when want dismiss phone call [alertviewinstance d...
Read more

c# - Can ProtoBuf-Net deserialize to a flat class? -

c# - Can ProtoBuf-Net deserialize to a flat class? - protobuf-net uses nested protobuf constructs back upwards inheritance. however, can made force properties flat target class has same properties inherited "serialized" version? see test illustration below. needless result of flat namespace null both properties. possible solution: re-create info flat.b first on property property basis. note: not prefered option. using system; namespace hierarchy { using protobuf; [protocontract] public class { [protomember(1)] public string prop1 { get; set; } } [protocontract] public class b : { public b() { } [protomember(1)] public string prop2 { get; set; } public override string tostring() { homecoming "prop1=" + prop1 + ", prop2=" + prop2; } } } namespace flat { using protobuf; [protocontract] p...
Read more

javascript - Change element in each JQuery tab to dynamically generated colors -

javascript - Change element in each JQuery tab to dynamically generated colors - i'm using jquery ui tabs widget , have button add together additional tabs. i'm tying each tab markers on map coordinating randomly generated color using function gen_color() { homecoming '#'+(math.random()*0xffffff<<0).tostring(16); } so each tab has color corresponds number of markers of same color on map. i'm trying add together 15x15 block of color within tab's tab left of it's label. right i'm using tabtemplate alternative , trying alter when new tab added: $tabs = $("#tabs").tabs({ tabtemplate: "<li><span class='ui-icon-color' style='background-color:#000000;'></span><a href='#{href}'>#{label}</a> <span class='ui-icon ui-icon-close'>remove tab</span></li>", selected: 0, add: funct...
Read more