You are specificly asking for the swordsman class or do you mean knight/crusader?
For a swordsman, make sure you have some dex, like 10-15, so you'll be able to hit monsters.
Then you can go melee build or skill build.
Melee is just agi, dex and vit, maybe luk if you like Crits.
For Skill build (i.e Bash, Magnum break), putt str, vit and some int. (Int so you won't have to drink Grapejuice after each skill)
For melee, just stay at payon dungeon, but slowly try orc dungeon after reaching level 25. Just attack enemies and dot dot dot, simple as that.
For skillbuild (Recommend), stay at payon dungeon, but head to orc dungeon later.
Do the following in Orc dungeon: First off, make sure you have quite some Str, carry meat, and some GJ. Endure yourself, then try to mob (Never more then 5 monsters, start with 2-3) Spam Magnum break.
2 or 3 Magnum breaks would kill all of them, so you should be fine.