d-store down on TBG9

[zma]

(08-15-2015 05:16 PM)xwcwt Wrote:  Some errors when I re-exec rsync cmd:

Code:

rsync: rename "/mnt/dstore/linux/releases/20/Everything/os/Packages/d/.dragon-4.11.3-1.fc20.x86_64.rpm.tcURLN" -> "linux/releases/20/Everything/os/Packages/d/dragon-4.11.3-1.fc20.x86_64.rpm": Input/output error (5)
rsync: rename "/mnt/dstore/linux/releases/20/Everything/os/Packages/d/.dragonegg-3.3-11.fc20.x86_64.rpm.Nr9UDn" -> "linux/releases/20/Everything/os/Packages/d/dragonegg-3.3-11.fc20.x86_64.rpm": Input/output error (5)
rsync: rename "/mnt/dstore/linux/releases/20/Everything/os/Packages/d/.drascula-1.0-11.fc20.noarch.rpm.9dhLm1" -> "linux/releases/20/Everything/os/Packages/d/drascula-1.0-11.fc20.noarch.rpm": Input/output error (5)
rsync: rename "/mnt/dstore/linux/releases/20/Everything/os/Packages/d/.drascula-de-1.0-8.fc20.noarch.rpm.q8yKey" -> "linux/releases/20/Everything/os/Packages/d/drascula-de-1.0-8.fc20.noarch.rpm": Input/output error (5)
rsync: rename "/mnt/dstore/linux/releases/20/Everything/os/Packages/d/.drascula-es-1.0-8.fc20.noarch.rpm.YWD2Ec" -> "linux/releases/20/Everything/os/Packages/d/drascula-es-1.0-8.fc20.noarch.rpm": Input/output error (5)

The cmd used is :

Code:

rsync -avrt  fedora/ dstore@10.88.14.2:/mnt/dstore/

HDFS does not support rewriting existing files, while rsync tries to do so with many common options. And HDFS' file attribute is not update every time the files is modified within a small time span after last modification, which causes rsync think the existing files in D-store is older some times.

Please try the one as in the post whose link @amoners just posted.