Encrypted Blitz issue (DEBIAN/UB)

skijbal

PG Sergeant
Oct 4, 2018
40
9
8
Reactions
9 0 0
#1
Fresh Ubuntu install and running 8.0.19. The file is in pgblitz/upload but won’t upload. A manual restart of blitz service triggers the upload.
 

JBM88

PG Specialist
Jun 30, 2018
10
5
8
Reactions
5 0 0
#2
After coming back from some meetings I can confirm same issue is still on Debian 9 with Encrypted Blitz v2 after upgrading to 8.0.19 and redeploying.

New uploads in /pgblitz/upload/ are not triggered until service is restarted

service pgblitz status keeps piling up "Upload Test - Using C" messages again after 2h30min runtime.

Active: active (running) since Thu 2019-01-10 13:19:28 UTC; 2h 30min ago
Main PID: 29115 (bash)
Tasks: 14 (limit: 4915)
CGroup: /system.slice/pgblitz.service
├─20262 rclone moveto --min-age=2m --config /opt/appdata/plexguide/rclone.conf --transfers=16 --max-transfer=100G --exclude=**_HIDDEN~ --exclude=.unionfs/**
└─29115 /bin/bash /opt/appdata/pgblitz/pgblitz.sh

Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:29 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:30 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:30 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:30 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:30 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:30 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:30 pgvm bash[29115]: Upload Test - Using C
Jan 10 15:50:30 pgvm bash[29115]: Upload Test - Using C


I deployed a cronjob restarting the service hourly in the meantime until a permanent fix is available.
blitz output is empty
 

Admin9705

Administrator
Project Manager
Jan 17, 2018
4,685
1,989
113
Reactions
1,989 0 0
#3
so here is what i'll do, i'll modify one thing tonight and then build a sanity checker. are you guys using the encrypted version? sorry car getting worked on.
 
Assists Greatly with Development Costs

skijbal

PG Sergeant
Oct 4, 2018
40
9
8
Reactions
9 0 0
#4
so here is what i'll do, i'll modify one thing tonight and then build a sanity checker. are you guys using the encrypted version? sorry car getting worked on.
Yes I’m using encrypted version.
 

JBM88

PG Specialist
Jun 30, 2018
10
5
8
Reactions
5 0 0
#5
Yeah using encrypted version also maybe this helps as well. Checked the Syslog:

Jan 10 06:25:02 localhost bash[13183]: Upload Test - Using C
Jan 10 06:25:20 localhost bash[13183]: message repeated 763 times: [ Upload Test - Using C]
Jan 10 06:25:20 localhost rclone[4774]: /: Dir.Stat error: couldn't list directory: Get https://www.googleapis.com/drive/v3/files?alt=json&fields=XXX
Jan 10 06:25:31 localhost bash[13183]: Upload Test - Using C
Jan 10 06:25:31 localhost rclone[4774]: /: Dir.Stat error: couldn't list directory: Get https://www.googleapis.com/drive/v3/files?alt=json&fields=XXX

Jan 10 06:25:31 localhost bash[13183]: Upload Test - Using C
Jan 10 06:25:31 localhost bash[13183]: message repeated 2 times: [ Upload Test - Using C]

and so on.

I removed some of the output but visiting the above link to googleapis returns:
"Daily Limit for Unauthenticated Use Exceeded. Continued use requires signup."
 
Last edited:

Admin9705

Administrator
Project Manager
Jan 17, 2018
4,685
1,989
113
Reactions
1,989 0 0
#6
i'm going to build a sanity checker in it. i never added to the encrypted version. this would help catch other problems before modifying the code.
 

Admin9705

Administrator
Project Manager
Jan 17, 2018
4,685
1,989
113
Reactions
1,989 0 0
#7
encheck=$(cat /var/plexguide/pgclone.transport)
if [ "$encheck" == "eblitz" ]; then
keyuse="${keyuse}C"
fi

this is what the code is, it's basically saying that if encrypted is on, slap a C on front of it. When you look at your rclone conf, there should be a C on front of the gdsa's. That's how it uses the encrypted version

can you do cat /opt/plexguide/appdata/rclone.conf

and post what you have, just take the team drive and certian info out; typing on phone sorry :D
 

JBM88

PG Specialist
Jun 30, 2018
10
5
8
Reactions
5 0 0
#8
cat of rclone.conf

[tdrive]
client_id = XXXX
client_secret = XXXX
type = drive
token = {"access_token":"XXXX","token_type":"Bearer","refresh_token":"XXXX","expiry":"2019-01-10T17:03:15.263788644Z"}
team_drive = XXXX

[tcrypt]
type = crypt
remote = tdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX

[gdsa01]
type = drive
client_id =
client_secret =
scope = drive
root_folder_id =
service_account_file = /opt/appdata/pgblitz/keys/processed/gdsa01
team_drive = XXXX

[gdsa01C]
type = crypt
remote = gdsa01:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX

[gdsa02]
type = drive
client_id =
client_secret =
scope = drive
root_folder_id =
service_account_file = /opt/appdata/pgblitz/keys/processed/gdsa02
team_drive = XXXX

[gdsa02C]
type = crypt
remote = gdsa02:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX

[gdsa03]
type = drive
client_id =
client_secret =
scope = drive
root_folder_id =
service_account_file = /opt/appdata/pgblitz/keys/processed/gdsa03
team_drive = XXXX

[gdsa03C]
type = crypt
remote = gdsa03:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX

[gdsa04]
type = drive
client_id =
client_secret =
scope = drive
root_folder_id =
service_account_file = /opt/appdata/pgblitz/keys/processed/gdsa04
team_drive = XXXX

[gdsa04C]
type = crypt
remote = gdsa04:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX

[gdsa05]
type = drive
client_id =
client_secret =
scope = drive
root_folder_id =
service_account_file = /opt/appdata/pgblitz/keys/processed/gdsa05
team_drive = XXXX

[gdsa05C]
type = crypt
remote = gdsa05:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX

[gdsa06]
type = drive
client_id =
client_secret =
scope = drive
root_folder_id =
service_account_file = /opt/appdata/pgblitz/keys/processed/gdsa06
team_drive = XXXX

[gdsa06C]
type = crypt
remote = gdsa06:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX

[gdrive]
client_id = XXXX
client_secret = XXXX
type = drive
token = {"access_token":"XXXX","token_type":"Bearer","refresh_token":"XXXX","expiry":"2019-01-10T17:37:13.983591405Z"}

[gcrypt]
type = crypt
remote = gdrive:/encrypt
filename_encryption = standard
directory_name_encryption = true
password = XXXX
password2 = XXXX
 

Admin9705

Administrator
Project Manager
Jan 17, 2018
4,685
1,989
113
Reactions
1,989 0 0
#9
ah ok, that's good at least. you u see the C in front? That's what's it's for. Just gotta figure out why it errors out like that.


what do you get if you do this?

encheck=$(cat /var/plexguide/pgclone.transport)
if [ "$encheck" == "eblitz" ]; then
keyuse="${keyuse}C"
fi

echo $keyuse
 

JBM88

PG Specialist
Jun 30, 2018
10
5
8
Reactions
5 0 0
#10
yeah I now understand how it works and what that part of the code does. Thanks for the explanation.
If I can help you test the changes later on let me know, and drive safely.
 

Admin9705

Administrator
Project Manager
Jan 17, 2018
4,685
1,989
113
Reactions
1,989 0 0
#11
yeah I now understand how it works and what that part of the code does. Thanks for the explanation.
If I can help you test the changes later on let me know, and drive safely.
just test that bottom code and see what output you get; car was getting serviced lol. thanks!
 

JBM88

PG Specialist
Jun 30, 2018
10
5
8
Reactions
5 0 0
#12
just test that bottom code and see what output you get
pgblitz.service - 'PGBlitz Loaded Balanced Multi SA GDrive Uploader'
Loaded: loaded (/etc/systemd/system/pgblitz.service; enabled; vendor preset: enabled)
Active: active (running) since Thu 2019-01-10 17:25:57 UTC; 15s ago
Main PID: 7621 (bash)
Tasks: 36 (limit: 4915)
CGroup: /system.slice/pgblitz.service
├─ 7621 /bin/bash /opt/appdata/pgblitz/pgblitz.sh
└─11773 rclone moveto --min-age=2m --config /opt/appdata/plexguide/rclone.conf --transfers=16 --max-transfer=100G --exclude=**_HIDDEN~ --exclude=.unionfs/** --exclude=**partial~ --exclude=.unionfs-fuse/** --max-size=99G --drive-chunk-size=128M /mnt/move/ /mnt/pgblitz/upload

Jan 10 17:26:15 pgvm bash[7621]: C
Jan 10 17:26:15 pgvm bash[7621]: Upload Test - Using C
Jan 10 17:26:15 pgvm bash[7621]: C
Jan 10 17:26:15 pgvm bash[7621]: Upload Test - Using C
Jan 10 17:26:15 pgvm bash[7621]: C
Jan 10 17:26:15 pgvm bash[7621]: Upload Test - Using C
Jan 10 17:26:15 pgvm bash[7621]: C
Jan 10 17:26:15 pgvm bash[7621]: Upload Test - Using C
Jan 10 17:26:15 pgvm bash[7621]: C
Jan 10 17:26:15 pgvm bash[7621]: Upload Test - Using C

I really start to dislike the letter C :p
 

PG Developer Donations

 

Forum statistics

Threads
2,962
Messages
18,630
Members
5,924
Latest member
chrisi21