It usually makes importing easier if you know the data structure. I always export data to CSV to see what kind of CSV import file should I create.

In this case, the data looks something like this (see better formatted version here):

id                                                       name                                 action        action_desc/id    employee_id/id
hr_attendance.attendance20    2014-09-10 12:34:00    Sign Out                                    hr.employee_fp
hr_attendance.attendance19    2014-09-10 07:10:00    Sign In                                       hr.employee_fp

So, now you can create a CSV file with mandatory fields name, action and employee_id/id. The trickiest one will be employee_id/id because you have to find out each employee's employee ID. You can do this by exporting the Employee names into a CSV file (the ID will be added automatically) and using it as a source for the attendance CSV. It might be easiest to use Excel/LibreOffice Calc/Google Spreadsheets and the VLOOKUP spreadsheet function for this.

Now you should have a CSV file with fields name, action and employee_id/id ready to be imported. Just click the "import" link next to the "Create" button and validate & import.