Error 400 Bad Request

[Maverick401-cmd]

Whenever I try to run the program it gives me an error saying

File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.12_3.12.2800.0_x64__qbz5n2kfra8p0\Lib\urllib\request.py", line 639, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 400: Bad Request

Is there anything I'm doing wrong

[daniel-widrick]

are there any more details in the error? my first quest would be something incorrect in zap2itconfig.ini

[metalpatton]

I'm getting the same 400 error when running either of the following on Windows:

"C:\Python\python.exe" "C:\zap2it\zap2it-GuideScrape.py" -c "C:\zap2it\zap2itconfig.ini" -C
"C:\Python\python.exe" "C:\zap2it\zap2it-GuideScrape.py" -c "C:\zap2it\zap2itconfig.ini" -o "C:\zap2it\xmltv.xml"

Here is the output:

Traceback (most recent call last):
  File "C:\zap2it\zap2it-GuideScrape.py", line 431,
in <module>
    guide.showAvailableChannels()
  File "C:\zap2it\zap2it-GuideScrape.py", line 366,
in showAvailableChannels
    my_json = guide.GetData(time.time(), zipCode)
  File "C:\zap2it\zap2it-GuideScrape.py", line 130,
in GetData
    response = urllib.request.urlopen(request).read()
  File "urllib\request.py", line 222, in urlopen
  File "urllib\request.py", line 531, in open
  File "urllib\request.py", line 640, in http_response
  File "urllib\request.py", line 569, in error
  File "urllib\request.py", line 502, in _call_chain
  File "urllib\request.py", line 649, in http_error_default
urllib.error.HTTPError: HTTP Error 400: Bad Request

Below is what my zap2itconfig.ini looks like. Any ideas what I might be doing wrong?

[creds]
Username: foo@bar.org
Password: fakepassword
[prefs]
country: USA
zipCode: [98121]
historicalGuideDays: 0
guideDays: 1
favoriteChannels:
lang: en
[lineup]
headendId: DISH819
lineupId: USA-DISH819-DEFAULT
device: -

[daniel-widrick]

try this and let me know:

[lineup]
headendId: DISH819
lineupId: USA-DISH819-DEFAULT
device: X

[metalpatton]

Making that modification to my INI worked. I no longer get the HTTP Error 400 and I am able to download guide listings. Thanks for your help! 👍

I have been using a Java-based xml to mxf (Windows Media Center guide format) converter for several years. When trying to convert the new xml using it, I'm getting a parsing error. Now I'll go try to figure out why that is. 😒

[mogorman]

I am getting the 400 issue as well. I am using an over the air antenna.

[creds]
Username:MYUSER
Password: MYPASS
[prefs]
country: USA
zipCode: 02190
historicalGuideDays: 14
lang: en
[lineup]
headendId: lineupId
lineupId: USA-lineupId-DEFAULT
device: -

I have tried device: and device: x with no luck as well.

python ./zap2it-GuideScrape.py -f
Namespace(configfile=None, outputfile=None, language=None, findid=True, channels=False, web=False)
Loading config:  ./zap2itconfig.ini  and outputting:  xmlguide.xmltv
Checking for environment variable: ZAP2IT_PREFS_LANG
Using config.ini value for prefs.lang
Checking for environment variable: ZAP2IT_PREFS_ZIPCODE
Using config.ini value for prefs.zipCode
Loaded Zip Codes:  ['02190']
Finding IDs for:  02190
Checking for environment variable: ZAP2IT_PREFS_COUNTRY
Using config.ini value for prefs.country
Checking for environment variable: ZAP2IT_PREFS_LANG
Using config.ini value for prefs.lang
Loading provider ID data from:  https://tvlistings.gracenote.com/gapzap_webapi/api/Providers/getPostalCodeProviders/USA/02190/gapzap/en
type           |name                                    |location       |headendID      |lineupId                 |device         
SATELLITE      |DISH Boston - Satellite                 |Boston         |DISH506        |USA-DISH506-DEFAULT      |X              
SATELLITE      |DIRECTV Boston - Satellite              |Boston         |DITV506        |USA-DITV506-DEFAULT      |X              
OTA            |Local Over the Air Broadcast            |               |lineupId       |USA-lineupId-DEFAULT     |               
CABLE          |Xfinity Weymouth - Digital              |Weymouth       |MA01110        |USA-MA01110-DEFAULT      |X              
CABLE          |Verizon Fios Burlington - Digital       |Leominster     |MA65213        |USA-MA65213-DEFAULT      |X              
SATELLITE      |AFN Satellite - Satellite               |USA            |AFN            |USA-AFN-DEFAULT          |X              
SATELLITE      |DIRECTV - Satellite                     |USA            |DITV           |USA-DITV-DEFAULT         |X              
SATELLITE      |DISH Network - Satellite                |USA            |ECHOST         |USA-ECHOST-DEFAULT       |X              
SATELLITE      |GLORYSTAR - Satellite                   |USA            |GLRYSTR        |USA-GLRYSTR-DEFAULT      |X              

and when i run I get the following

python ./zap2it-GuideScrape.py 
Namespace(configfile=None, outputfile=None, language=None, findid=False, channels=False, web=False)
Loading config:  ./zap2itconfig.ini  and outputting:  xmlguide.xmltv
Checking for environment variable: ZAP2IT_PREFS_LANG
Using config.ini value for prefs.lang
Checking for environment variable: ZAP2IT_CREDS_USERNAME
Using config.ini value for creds.username
Checking for environment variable: ZAP2IT_CREDS_PASSWORD
Using config.ini value for creds.password
Checking for environment variable: ZAP2IT_PREFS_GUIDEDAYS
Using config.ini value for prefs.guideDays
Loading guide data for  14  days
Checking for environment variable: ZAP2IT_PREFS_ZIPCODE
Using config.ini value for prefs.zipCode
Loaded Zip Codes:  ['02190']
Building data for {time} :: {zipCode}
Checking for environment variable: ZAP2IT_LINEUP_LINEUPID
Using config.ini value for lineup.lineupId
Checking for environment variable: ZAP2IT_LINEUP_HEADENDID
Using config.ini value for lineup.headendId
Checking for environment variable: ZAP2IT_LINEUP_DEVICE
Using config.ini value for lineup.device
Checking for environment variable: ZAP2IT_PREFS_COUNTRY
Using config.ini value for prefs.country
Load Guide for time:  1752507000.0  ::  02190
Traceback (most recent call last):
  File "/home/media/zap2it-GuideScraping/./zap2it-GuideScrape.py", line 466, in <module>
    guide.BuildGuide()
  File "/home/media/zap2it-GuideScraping/./zap2it-GuideScrape.py", line 330, in BuildGuide
    zip_json = self.GetData(loopTime,zipCode)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/media/zap2it-GuideScraping/./zap2it-GuideScrape.py", line 130, in GetData
    response = urllib.request.urlopen(request).read()
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/99hl269v1igvjbp1znfk5jcarhzgy822-python3-3.12.8/lib/python3.12/urllib/request.py", line 215, in urlopen
    return opener.open(url, data, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/99hl269v1igvjbp1znfk5jcarhzgy822-python3-3.12.8/lib/python3.12/urllib/request.py", line 521, in open
    response = meth(req, response)
               ^^^^^^^^^^^^^^^^^^^
  File "/nix/store/99hl269v1igvjbp1znfk5jcarhzgy822-python3-3.12.8/lib/python3.12/urllib/request.py", line 630, in http_response
    response = self.parent.error(
               ^^^^^^^^^^^^^^^^^^
  File "/nix/store/99hl269v1igvjbp1znfk5jcarhzgy822-python3-3.12.8/lib/python3.12/urllib/request.py", line 559, in error
    return self._call_chain(*args)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/nix/store/99hl269v1igvjbp1znfk5jcarhzgy822-python3-3.12.8/lib/python3.12/urllib/request.py", line 492, in _call_chain
    result = func(*args)
             ^^^^^^^^^^^
  File "/nix/store/99hl269v1igvjbp1znfk5jcarhzgy822-python3-3.12.8/lib/python3.12/urllib/request.py", line 639, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 400: Bad Request

[sushisam77]

I'm hitting this as well. Was working fine yesterday. There must have been some change on the back-end. Not sure if this helps, but if i copy and paste the URL it's trying to get into a browser, I get:

{"message":"No lineups are available for this ZIP or postal code. Please enter a different ZIP or postal code."}

[sushisam77]

It looks like a couple values in the URL changed. I found this:

jef/zap2xml@2809b27

Seems to work after changing those values.

[Py1970]

This 400 error just started for me last night.

[sushisam77]

It looks like a couple values in the URL changed. I found this:

jef/zap2xml@2809b27

Seems to work after changing those values.

This stopped working as well :(

[mogorman]

other repo makes it look like at the moment its down or shut off for future jef/zap2xml#36

[Py1970]

Anyone have any luck? Or is the end of gracenote?

[daniel-widrick]

it seems that gracenote has shutdown the old endpoint.

I had previously reached out to them about getting bone fide api access. I was quoted a per user pricing structure with a minimum user count that seemed infeasible.

I'll be looking into alternatives and have a few ideas (this was expected after their last user agent blocking)... I don't presently have a timeline.

[Py1970]

it seems that gracenote has shutdown the old endpoint.

I had previously reached out to them about getting bone fide api access. I was quoted a per user pricing structure with a minimum user count that seemed infeasible.

I'll be looking into alternatives and have a few ideas (this was expected after their last user agent blocking)... I don't presently have a timeline.

Interesting. So all of these changes on their part are intentional to keep us from scraping?

[Py1970]

@daniel-widrick

This fixed the issue for me: jef/zap2xml#36 (comment)

Changing the affiliated id correct the 404 issue for me.

In the request https://tvlistings.gracenote.com/api/grid?, I change the following parameters
'AffiliateId': "orbebb" and 'aid': 'orbebb'

[mcondorx]

@daniel-widrick

This fixed the issue for me: jef/zap2xml#36 (comment)

That worked for me as well. I was able to get my normal 10 day update,
and the data looks good.

I greatly appreciate the efforts of both this git and jef's for working on
these issues which have been becoming more common.

If something had not gotten working, I set a personal deadline on Sunday
to try to cutover to one of the two paid providers I could find.

What I found are xmltvlistings.com with a yearly $20 sub, and schedulesdirect.org with
a $35 yearly sub. They both have a 14 day trial with a credit card upfront,

That price matches me upgrading my HDHR Homerun to DVR service which also gets
a guide which reportedly can be exported.

Thanks to all for working on this!

• Mark