Handle data while filming with rPI
We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.
I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).
When I insert the SSD, the hole SSD should be copied to a 4TB HDD.
So I have 4 questions:
Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source
What's the average file transfer speed of the rPi from USB to USB?
Is there a software which allready can do this (Preferable with a data validation)
Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.
pi-3b+ data-transfer
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
add a comment |
We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.
I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).
When I insert the SSD, the hole SSD should be copied to a 4TB HDD.
So I have 4 questions:
Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source
What's the average file transfer speed of the rPi from USB to USB?
Is there a software which allready can do this (Preferable with a data validation)
Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.
pi-3b+ data-transfer
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks♦
2 days ago
The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
yesterday
@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
yesterday
add a comment |
We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.
I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).
When I insert the SSD, the hole SSD should be copied to a 4TB HDD.
So I have 4 questions:
Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source
What's the average file transfer speed of the rPi from USB to USB?
Is there a software which allready can do this (Preferable with a data validation)
Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.
pi-3b+ data-transfer
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
We will buy the BMPCC4k (This means 500GB/hour on a ssd), as we are a low/no-budget production, we can't have someone handling data.
I had the idea to use a rPI3+ to use for this.
But I'm not sure if the rPI is able to handle this, he would be powered by a powerbank (20'000mAh).
When I insert the SSD, the hole SSD should be copied to a 4TB HDD.
So I have 4 questions:
Can the rPI Power an external HDD (2.5" 4TB) + external SSD (Samsung T5 500GB) form the USB Power Source
What's the average file transfer speed of the rPi from USB to USB?
Is there a software which allready can do this (Preferable with a data validation)
Which is the best OS to use for this? I'm only familiar with Raspbian, but can adapt.
pi-3b+ data-transfer
pi-3b+ data-transfer
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
asked 2 days ago
Timothy Lukas H.Timothy Lukas H.
114
114
You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks♦
2 days ago
The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
yesterday
@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
yesterday
add a comment |
You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks♦
2 days ago
The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
yesterday
@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
yesterday
You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks♦
2 days ago
You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks♦
2 days ago
The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
yesterday
The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
yesterday
@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
yesterday
@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
yesterday
add a comment |
1 Answer
1
active
oldest
votes
The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).
I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).
(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.
(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
2 days ago
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("schematics", function () {
StackExchange.schematics.init();
});
}, "cicuitlab");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "447"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fraspberrypi.stackexchange.com%2fquestions%2f92721%2fhandle-data-while-filming-with-rpi%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).
I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).
(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.
(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
2 days ago
add a comment |
The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).
I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).
(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.
(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
2 days ago
add a comment |
The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).
I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).
(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.
(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
The Raspberry Pi (all models) feature USB 2.0 ("Hi-Speed") only; which has a net data transfer of 40 MB/s at best (1); real life performance might even be less (2). Share that data rate between inbound (SSD) and outbound (HDD) traffic will yield 20 MB/s. So for 500 GB per hour that transfer is going to take about 25,000 seconds - which I believe are significantly more seconds than one hour has (about seven hours).
I doubt that this is a feasible approach if you intend to copy data during the production day. You'll need to look for faster systems that provide USB 3.x; preferable 3.1 or higher - dubbed "SuperSpeed +" - for a data rate in the GB/s range (Wikipedia#USB).
(1) USB 2.0 has a maximum signaling rate of 480 Mbit/s which is equivivalent to 60 MB/s ((Wikipedia#USB)). This results in a net data rate of 40 MB/s (de.Wikipedia#USB) due to protocol overhead and what-not.
(2) e.g. "SSD read test (reading 3.2GB) using a Pi3B came in at 35MB/s" (source)
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
edited 2 days ago
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
answered 2 days ago
Ghanima♦Ghanima
12.1k93978
12.1k93978
Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
2 days ago
add a comment |
Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
2 days ago
Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
2 days ago
Thank you! It really seems this won't do it. It's 500GB/hour of footage. Not hpur of filming. But we'll probabbly film more than an hour/day :/
– Timothy Lukas H.
2 days ago
add a comment |
Thanks for contributing an answer to Raspberry Pi Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fraspberrypi.stackexchange.com%2fquestions%2f92721%2fhandle-data-while-filming-with-rpi%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
You won't be able to run the Pi and two drives from a powerbank. You might not even be able to run the Pi off it predictably. If you can, it will never last the seven hours Ghanima indicates it would take to transfer the data.
– goldilocks♦
2 days ago
The idea might be feasible if you are not strictly limited to Raspberry. Not an answer because I never tried it and because it is not Raspberry, but there exist other brands of single board computers, inspired by the Raspberry success. See en.wikipedia.org/wiki/Comparison_of_single-board_computers and for example some ODROID models seem to support USB 3.0 and are currently available. No idea about the real world performance though.
– szulat
yesterday
@szulat Ouh yeah. I was thinking about building a PCB myself to do it, but as it's quite critical that the data is safe, this isn't really an option for me. But I will take a look at the other SBCs :)
– Timothy Lukas H.
yesterday