Invitation to meet in Cairo was relayed by Palestinian President Abbas; party members fear visit will draw criticism from constituents for ignoring more urgent, domestic problems.