ROS Resources: Documentation | Support | Discussion Forum | Service Status | Q&A answers.ros.org

Updated rsync endpoints


#1

Mirror Maintainers,

Our experiment in the previous thread successfully stabilized the ROS wiki performance by removing the rsync disk load from that main webserver. As such we have shuffled the locations for rsync hosting of the wiki and docs mirrors.

The new urls to pull from are rsync.osuosl.org::ros_docs_mirror and rsync.osuosl.org::ros_wiki_mirror.

I’ve updated the documentation on http://wiki.ros.org/Mirrors as well as the github repo for the puppet deployment: https://github.com/ros-infrastructure/mirror in PR#10

However this will need manual intervention as the mirrors are not setup to self reconfigure the cron jobs. As such assuming you’re running the standard configuration you can just run the following commands.

cd mirror/
git pull
sudo puppet apply ros_mirror.pp --modulepath=/etc/puppet/modules:/usr/share/puppet/modules:.

And you should see an output like:

Warning: The use of 'import' is deprecated at /home/ubuntu/mirror/ros_mirror.pp:3. See http://links.puppetlabs.com/puppet-import-deprecation
   (at /var/lib/gems/1.9.1/gems/puppet-3.8.7/lib/puppet/parser/parser_support.rb:110:in `import')
Warning: Config file /etc/puppet/hiera.yaml not found, using Hiera defaults
Notice: Compiled catalog for ip-172-31-1-196.ap-southeast-1.compute.internal in environment production in 1.61 seconds
Notice: /Stage[main]/Main/Cron[docs.ros.org_mirror]/command: command changed 'rsync -aqz docs.ros.org::mirror /mirror/docs.ros.org --bwlimit=200 --copy-unsafe-links --delete' to 'rsync -aqz rsync.osuosl.org::ros_docs_mirror /mirror/docs.ros.org --bwlimit=200 --copy-unsafe-links --delete'
Notice: /Stage[main]/Main/Cron[wiki.ros.org_mirror]/command: command changed 'rsync -aqz wiki.ros.org::wiki_mirror /mirror/wiki.ros.org --bwlimit=200 --copy-unsafe-links --delete' to 'rsync -aqz rsync.osuosl.org::ros_wiki_mirror /mirror/wiki.ros.org --bwlimit=200 --copy-unsafe-links --delete'
Notice: Finished catalog run in 0.94 seconds

If you have manually configured the cron jobs. Please update them accordingly.

We will keep the old rsync end points on through at least the end of this week. But since the wiki has become quite unstable we do not want to take a very long time to make this transition.


Ros.org latency & availability
#2

Since the rsync jobs have been causing a lot of down time we’ve decided to take the old rsync endpoints offline ahead of schedule. Please take a moment and update your mirrors to use the new urls.