The annual migration of Irish farm workers to work at the harvest in Scotland was established before the advent of steam ships. The phrase "the boat that first brought me over" implies that the narrator had made several subsequent trips.