[BUG] Metadata will not download.

[Mouseater]

Is there an existing issue for this?

• I have searched the existing issues

Current Behavior

Can't download metadata for books. I get this error
calibre, version 9.8.0
ERROR: Download failed: Failed to download metadata or covers for any of the 4 books.

Mark of Calth (Failed metadata) (Failed cover)
Shadows of Treachery (Failed metadata) (Failed cover)
Praetorian of Dorn (Failed metadata) (Failed cover)
Tallarn: Executioner (Failed metadata) (Failed cover)

These books are an example, but even books that I have previously gotten data for can no longer get data. I have only ever had 9.8.0 installed.

Expected Behavior

metadata should download

Steps To Reproduce

1. choose a book and download metadat
2. wait, and at some point metadata will no longer be able to be downloaded for anything. I have no idea what causes it to stop working

Environment

- OS:Unraid 7.2.4
- How docker service was installed: Community App Store

CPU architecture

x86-64

Docker creation

I clicked the install button in unraid

Container logs

text  error  warn  system  array  login  

INFO:selkies_gamepad:JS interposer server listening on /tmp/selkies_js3.sock
INFO:selkies_gamepad:EVDEV interposer server listening on /tmp/selkies_event1000.sock
INFO:selkies_gamepad:EVDEV interposer server listening on /tmp/selkies_event1001.sock
INFO:selkies_gamepad:EVDEV interposer server listening on /tmp/selkies_event1002.sock
INFO:selkies_gamepad:EVDEV interposer server listening on /tmp/selkies_event1003.sock
INFO:data_websocket:Data WebSocket Server listening on port 8082
INFO:data_websocket:Legacy client ('127.0.0.1', 52574) connected. Role: controller, Slot: None
INFO:data_websocket:Data WebSocket connected from ('127.0.0.1', 52574)
INFO:data_websocket:Attempting to establish PulseAudio connection...
INFO:data_websocket:PulseAudio connection established.
INFO:data_websocket:Registering new client for display: primary
INFO:data_websocket:Applying and sanitizing client settings for 'primary' (initial=True)
INFO:data_websocket:DPI changed from None to 96. Applying system-level change.
INFO:data_websocket:Wayland Settings: Executing 'wlr-randr --output WL-1 --scale 1.0' on wayland-0
INFO:data_websocket:Initial setup or dimensional change detected for 'primary'. Performing full display reconfiguration.
INFO:data_websocket:Starting display reconfiguration...
INFO:data_websocket:Calculating new extended desktop layout from ALL clients...
INFO:data_websocket:Layout calculated: Total Size=1920x920. Layouts: {'primary': {'x': 0, 'y': 0, 'w': 1920, 'h': 920}}
INFO:data_websocket:Starting separate capture instances for each ACTIVE display region...
INFO:data_websocket:Client 'primary' is active. Starting its capture.
INFO:data_websocket:Preparing to start capture for display='primary': Res=1920x920, Offset=0x0
INFO:data_websocket:Registered Wayland cursor callback for 'primary'
INFO:data_websocket:SUCCESS: Capture started for 'primary'.
INFO:data_websocket:Broadcasting primary stream resolution to all clients: {"type": "stream_resolution", "width": 1920, "height": 920}
INFO:data_websocket:Broadcasting display config update: DISPLAY_CONFIG_UPDATE,{"type": "display_config_update", "displays": ["primary"]}
INFO:data_websocket:Display reconfiguration finished successfully.
INFO:data_websocket:Reconfiguration process complete (state unlocked).
INFO:data_websocket:Initial client settings message processed by ws_handler.
INFO:data_websocket:Initial setup: Primary client connected, audio not active, attempting start.
INFO:data_websocket:Starting pcmflux audio pipeline...
INFO:data_websocket:pcmflux settings: device='output.monitor', bitrate=320000, channels=2
INFO:data_websocket:Video chunk sender started for display 'primary'.
INFO:data_websocket:pcmflux audio capture started successfully.
INFO:data_websocket:pcmflux audio chunk broadcasting task started.
INFO:data_websocket:Received START_AUDIO command from client for server-to-client audio.
INFO:data_websocket:START_AUDIO: pcmflux audio pipeline already active.
INFO:data_websocket:Received redundant resize request for primary (1920x920). No action taken.
INFO:webrtc_input:Set clipboard content, length: 42
INFO:webrtc_input:Clipboard changed. Sending content (text/plain)
INFO:webrtc_input:Set clipboard content, length: 42
INFO:data_websocket:Received STOP_VIDEO for 'primary'. Stopping stream.
INFO:data_websocket:Stopping all streams for display 'primary'...
INFO:data_websocket:Successfully stopped all streams for display 'primary'.
INFO:data_websocket:Video chunk sender for 'primary' cancelled.
INFO:data_websocket:Video chunk sender for 'primary' finished.
INFO:data_websocket:Received START_VIDEO for 'primary'. Starting its stream.
INFO:data_websocket:Found existing layout for 'primary'. Starting capture with: {'x': 0, 'y': 0, 'w': 1920, 'h': 920}
INFO:data_websocket:Preparing to start capture for display='primary': Res=1920x920, Offset=0x0
INFO:data_websocket:Registered Wayland cursor callback for 'primary'
INFO:data_websocket:Video chunk sender started for display 'primary'.
INFO:data_websocket:SUCCESS: Capture started for 'primary'.
INFO:webrtc_input:Set clipboard content, length: 156
INFO:webrtc_input:Clipboard changed. Sending content (text/plain)
INFO:data_websocket:Received STOP_VIDEO for 'primary'. Stopping stream.
INFO:data_websocket:Stopping all streams for display 'primary'...
INFO:data_websocket:Successfully stopped all streams for display 'primary'.
INFO:data_websocket:Video chunk sender for 'primary' cancelled.
INFO:data_websocket:Video chunk sender for 'primary' finished.
INFO:data_websocket:Received START_VIDEO for 'primary'. Starting its stream.
INFO:data_websocket:Found existing layout for 'primary'. Starting capture with: {'x': 0, 'y': 0, 'w': 1920, 'h': 920}
INFO:data_websocket:Preparing to start capture for display='primary': Res=1920x920, Offset=0x0
INFO:data_websocket:Registered Wayland cursor callback for 'primary'
INFO:data_websocket:Video chunk sender started for display 'primary'.
INFO:data_websocket:SUCCESS: Capture started for 'primary'.
INFO:webrtc_input:Set clipboard content, length: 156
INFO:data_websocket:Received STOP_VIDEO for 'primary'. Stopping stream.
INFO:data_websocket:Stopping all streams for display 'primary'...
INFO:data_websocket:Successfully stopped all streams for display 'primary'.
INFO:data_websocket:Video chunk sender for 'primary' cancelled.
INFO:data_websocket:Video chunk sender for 'primary' finished.
[svc-de] Wayland mode: Waiting for socket at /config/.XDG/wayland-1...
[svc-de] /config/.XDG/wayland-1 found launching de
[Wayland] Configuring Output: 1920x920 @ 60.00 FPS (Scale 1.00)
[Wayland] CPU encoding selected (use_cpu=true or vaapi_node=-1).
[Wayland] Decision: No GPU Encoder available -> Using CPU Software Encoding.
Stream settings active -> Res: 1920x920 | FPS: 60.0 | Stripes: 1 | Mode: H264 (CPU) FullFrame | CRF: 25 | PaintOver CRF: 18 (Burst: 5f) | Colorspace: I420 (Limited Range) | Damage Thresh: 10f | Damage Dur: 20f
[pcmflux] Attempting to connect to PulseAudio device: output.monitor with latency: 10ms
[pcmflux] SUCCESS: Connected to PulseAudio.
[pcmflux] SUCCESS: Opus encoder created.
[pcmflux] Capture loop started. Device: output.monitor, Rate: 48000, Channels: 2, Bitrate: 320 kbps, VBR: On, Silence Gate: Off, Debug Logging: Off, PCM Chunk: 3840 bytes
[pcmflux] First non-silent audio chunk detected! Encoding...
[Wayland] Capture loop stopped.
[Wayland] CPU encoding selected (use_cpu=true or vaapi_node=-1).
[Wayland] Decision: No GPU Encoder available -> Using CPU Software Encoding.
Stream settings active -> Res: 1920x920 | FPS: 60.0 | Stripes: 1 | Mode: H264 (CPU) FullFrame | CRF: 25 | PaintOver CRF: 18 (Burst: 5f) | Colorspace: I420 (Limited Range) | Damage Thresh: 10f | Damage Dur: 20f
[Wayland] Capture loop stopped.
[Wayland] CPU encoding selected (use_cpu=true or vaapi_node=-1).
[Wayland] Decision: No GPU Encoder available -> Using CPU Software Encoding.
Stream settings active -> Res: 1920x920 | FPS: 60.0 | Stripes: 1 | Mode: H264 (CPU) FullFrame | CRF: 25 | PaintOver CRF: 18 (Burst: 5f) | Colorspace: I420 (Limited Range) | Damage Thresh: 10f | Damage Dur: 20f
[Wayland] Capture loop stopped.
INFO:data_websocket:Received START_VIDEO for 'primary'. Starting its stream.
INFO:data_websocket:Found existing layout for 'primary'. Starting capture with: {'x': 0, 'y': 0, 'w': 1920, 'h': 920}
INFO:data_websocket:Preparing to start capture for display='primary': Res=1920x920, Offset=0x0
INFO:data_websocket:Registered Wayland cursor callback for 'primary'
INFO:data_websocket:Video chunk sender started for display 'primary'.
[Wayland] CPU encoding selected (use_cpu=true or vaapi_node=-1).
[Wayland] Decision: No GPU Encoder available -> Using CPU Software Encoding.INFO:data_websocket:SUCCESS: Capture started for 'primary'.

Stream settings active -> Res: 1920x920 | FPS: 60.0 | Stripes: 1 | Mode: H264 (CPU) FullFrame | CRF: 25 | PaintOver CRF: 18 (Burst: 5f) | Colorspace: I420 (Limited Range) | Damage Thresh: 10f | Damage Dur: 20f
INFO:webrtc_input:Set clipboard content, length: 156
INFO:webrtc_input:Set clipboard content, length: 156
INFO:webrtc_input:Clipboard changed. Sending content (text/plain)
INFO:data_websocket:Received STOP_VIDEO for 'primary'. Stopping stream.
INFO:data_websocket:Stopping all streams for display 'primary'...
INFO:data_websocket:Successfully stopped all streams for display 'primary'.
[Wayland] Capture loop stopped.
INFO:data_websocket:Video chunk sender for 'primary' cancelled.
INFO:data_websocket:Video chunk sender for 'primary' finished.

[github-actions]

Thanks for opening your first issue here! Be sure to follow the relevant issue templates, or risk having this issue marked as invalid.

[j0nnymoe]

Need the docker run please, unraid does provide this for you when you deploy the container.

[Mouseater]

Need the docker run please, unraid does provide this for you when you deploy the container.

docker run
-d
--name='calibre'
--net='bridge'
--pids-limit 2048
-e TZ="America/Chicago"
-e HOST_OS="Unraid"
-e HOST_HOSTNAME="HOSTNAME"
-e HOST_CONTAINERNAME="calibre"
-e 'CLI_ARGS'=''
-e 'PUID'='99'
-e 'PGID'='100'
-e 'UMASK'='022'
-l net.unraid.docker.managed=dockerman
-l net.unraid.docker.webui='https://[IP]:[PORT:8181]'
-l net.unraid.docker.icon='https://raw.githubusercontent.com/linuxserver/docker-templates/master/linuxserver.io/img/calibre-logo.png'
-p '8090:8080/tcp'
-p '8191:8181/tcp'
-p '8091:8081/tcp'
-v '/mnt/user/books/':'/libData':'rw'
-v '/mnt/user/appdata/calibre':'/config':'rw'
--shm-size=1gb 'lscr.io/linuxserver/calibre'
7739ab3f8c33b7577875cf9a2d0093ecac32586b1ddc248ed083bf70f9491569

[Mouseater]

I just updated to version 9.9 and am still getting this bug.

[j0nnymoe]

Unable to replicate, while 1 book couldn't be found due to what looked like the file format throwing the search off, other books have been fine. You need to read into the jobs details when you're searching for metadata to see what the actual errors are. Because if they're hitting google but not finding results, that's not a container problem.

[Mouseater]

How do I look into the job details, because when I click show details this is all I get.

[j0nnymoe]

Jobs in the bottom right corner then you'll see them listed.

[Mouseater]

Jobs in the bottom right corner then you'll see them listed.

ok, I can see more in the error there, but if I understood your previous comment any errors in that are not your problem since you just create the containers, issues there would be submitted somewhere else? I thought this was the place for calibre bugs but it seems like I was incorrect.

[Chirishman]

If it previously worked and has now stopped then I think you might actually be getting rate-limited or temp banned from some of the metadata sources. This happened to me a few months ago and resolved itself eventually after a few weeks. I've found it to be an increasing issue since more AI scraping has been going on in recent years which has lead to rate limit/IP autoban rules getting tightened.

In the interim you can try installing Calibre extensions for additional metadata sources like StoryGraph and unchecking the ones that you were previously using in the metadata retrieval config to not get your automatic ban extended.

[LinuxServer-CI]

This issue has been automatically marked as stale because it has not had recent activity. This might be due to missing feedback from OP. It will be closed if no further activity occurs. Thank you for your contributions.

[WhateverTheyCallMe]

I am also getting no metadata downloaded for many of my books. Here is an example:

"#################### Log for Atalanta ####################
Running identify query with parameters:
{'title': 'Atalanta', 'authors': ['Jennifer Saint'], 'identifiers': {}, 'timeout': 30}
Using plugins: Goodreads (1, 8, 5)
The log from individual plugins is below

****************************** Goodreads (1, 8, 5) ******************************
Found 0 results
Downloading from Goodreads took 0.13332581520080566
identify - start. title=Atalanta, authors=['Jennifer Saint'], identifiers={}
Querying: https://www.goodreads.com/search?search_type=books&search[query]=Atalanta+Jennifer+Saint
No goodreads id via ISBN
Failed to get raw result for query: 'https://www.goodreads.com/search?search_type=books&search[query]=Atalanta+Jennifer+Saint'

---

The identify phase took 0.20 seconds
The longest time (0.133326) was taken by: Goodreads
Merging results from different sources
We have 0 merged results, merging took: 0.00 seconds
Failed to download metadata for Atalanta

****************************** Goodreads Covers ******************************
Request extra headers: [('User-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/144.0.0.0 Safari/537.36')]
Failed to download valid cover
Took 0.06915950775146484 seconds
No cached cover found, running identify
identify - start. title=Atalanta, authors=['Jennifer Saint'], identifiers={}
Querying: https://www.goodreads.com/search?search_type=books&search[query]=Atalanta+Jennifer+Saint
No goodreads id via ISBN
Failed to get raw result for query: 'https://www.goodreads.com/search?search_type=books&search[query]=Atalanta+Jennifer+Saint'
No cover found

---

If I take the query address and put it in a browser, the search results has the correct book as the first result. So I don't know if this is a usage issue or something in a recent update but this has worked for years and suddenly in the last couple weeks 90% or more fail

Edit to add:
Also on unraid, current stable branch of linuxserver/calibre