Solved migrating files from usb hdd to unionfs

Status
Not open for further replies.

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
Hey guys,
I setup pgclone today the 4.5tb one, but it failed to copy after a few hundred gig to copy from my usb hdd to my unionfs mount.
I have just done a cp -a /source /dest command?
Is there another alternative I tried rsync but it was just lisitng files that had been done already and seemed ALOT slower.
Sorry for the typos im tierd been working on this for hours
 
M

MrDoob

Guest
PGBlitz pick the files from there

You must only copy the files into /mnt/move
 

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
ok cool, and that uses up my primrary drive not the usb drive correct? I assume pgblitz deletes them once uploaded?
 
M

MrDoob

Guest
If ypu copy only the files from source A to move they dont delete it.

If move the folder like this..

mv /source /mnt/move

Then yes
 
Last edited by a moderator:

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
Sorry just to confirm 100% I am copying from my usb hard drive to /mnt/live is mnt/live within gsuite or does it use the main drive on my unit as a cache per say? If it doesn't and this copy copies direct from my source to gsuite then that is what I'm trying to achieve. Thank you
 
M

MrDoob

Guest
/mnt/move (german layout sorry )

/source = your USB Drive
/mnt/move = PBlitz

dont copy direct to /mnt/unionfs
 
  • Like
Reactions: subse7en

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
Hey Mr doo ,

No luck that seems to fill my ssd too quickly, is there a way to symbolically link my usb hdd to upload automatically.
 
M

MrDoob

Guest
give me please the folder name ,,

i will create the correct path for you .. the add this lines to pgblitz .sh

and the rest will PGblitz done for you



i need this >>>> /mnt/foldername/usb/
from you USB device
 
Last edited by a moderator:
M

MrDoob

Guest
add this to your pgblitz.sh


backup yout pgblitz.sh

# cd /opt/appdata/pgblitz/
# cp pgblitz.sh backup.pgblitz.sh
# nano pgblitz.sh


add it under >>>>

line >>>> sleep 30


Bash:
dlpath2=/media/sconnery/

  rclone moveto "$dlpath2" "$dlpath/move/" \
  --config /opt/appdata/plexguide/rclone.conf \
  --log-file=/var/plexguide/logs/pgblitz.log \
  --log-level INFO --stats 5s \
  --min-age=5s \
  --max-size=100G \
  --exclude="**_HIDDEN~" --exclude=".unionfs/**" \
  --exclude='**partial~' --exclude=".unionfs-fuse/**"

@Admin9705 i think thats works ?

or any changes ???


so i edit the lines
 
Last edited by a moderator:

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
ok ill added that and re deployed it , do i need to do anything for it to initiate? thanks
 
M

MrDoob

Guest
if you redeploy this .. the lines are deleted


stop the service and start it .


service pgblitz stop
service pgblitz status
service pgblitz start

and then --- >>>>> blitz
 

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
PG Blitz Log - Cycle 5

Utilizing: gdsa05
2019/02/06 11:19:11 INFO : Starting bandwidth limiter at 20MBytes/s
2019/02/06 11:19:11 INFO : Starting HTTP transaction limiter: max 12 transactions/s with burst 1
2019/02/06 11:19:13 NOTICE: movies/BlacKkKlansman (2018): Duplicate directory found in destination - ignoring
2019/02/06 11:19:13 NOTICE: movies/Black Swan (2010): Duplicate directory found in destination - ignoring
2019/02/06 11:19:13 NOTICE: movies/Blackhat (2015): Duplicate directory found in destination - ignoring
2019/02/06 11:19:13 NOTICE: movies/Blade (1998): Duplicate directory found in destination - ignoring
2019/02/06 11:19:13 NOTICE: movies/Blade II (2002): Duplicate directory found in destination - ignoring
2019/02/06 11:19:13 INFO : Google drive root '': Waiting for checks to finish
2019/02/06 11:19:13 INFO : Google drive root '': Waiting for transfers to finish
2019/02/06 11:19:13 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 2.1s

Cycle 5 - Sleeping for 30 Seconds
 

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
keeps finding the same group of files and sleeping , There is 400 files but seems to sleep after these? Should I delete whats up there and start fresh
 
M

MrDoob

Guest
let it run .. the find dupes .. before the lines added the files are copy over cp -arv ..

this is now moveto ..


if any files not dupe they uploaded it ..

it will be work ...

if all files finish ... redeploy pgblitz for delete the added lines
 

sconnery

Respected Member
Original poster
Moderator
FreeLancer
Donor
Local time
10:49 PM
Jan 10, 2019
82
15
Sydney, Australia
when I added those lines , I did not modify or remove any others?
PG Blitz Log - Cycle 105

Utilizing: gdsa03
2019/02/06 12:12:48 INFO : Starting bandwidth limiter at 20MBytes/s
2019/02/06 12:12:48 INFO : Starting HTTP transaction limiter: max 12 transactions/s with burst 1
2019/02/06 12:12:50 NOTICE: movies/BlacKkKlansman (2018): Duplicate directory found in destination - ignoring
2019/02/06 12:12:50 NOTICE: movies/Black Swan (2010): Duplicate directory found in destination - ignoring
2019/02/06 12:12:50 NOTICE: movies/Blackhat (2015): Duplicate directory found in destination - ignoring
2019/02/06 12:12:50 NOTICE: movies/Blade (1998): Duplicate directory found in destination - ignoring
2019/02/06 12:12:50 NOTICE: movies/Blade II (2002): Duplicate directory found in destination - ignoring
2019/02/06 12:12:50 INFO : Google drive root '': Waiting for checks to finish
2019/02/06 12:12:50 INFO : Google drive root '': Waiting for transfers to finish
2019/02/06 12:12:50 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 0, -
Elapsed time: 2s

still getting the above though :(
 
Status
Not open for further replies.

Staff online

Maintenance Donations

Recommend NewsGroups

      Up To a 58% Discount!

Trending