日期:2014-05-16  浏览次数:20679 次

Greenplum利用gpload,gpfist实现数据入库

1.python版本要求2.4.4以上

[root@test install]# python
Python 2.6.2 (r262:71600, May 14 2009, 10:46:21) 
[GCC 4.1.2 20080704 (Red Hat 4.1.2-44)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> 

2.PyYAML 3.10包配置

Downloads ↓

YAML parser and emitter for Python

YAML is a data serialization format designed for human readability and interaction with scripting languages. PyYAML is a YAML parser and emitter for Python.

PyYAML features a complete YAML 1.1 parser, Unicode support, pickle support, capable extension API, and sensible error messages. PyYAML supports standard YAML tags and provides Python-specific tags that allow to represent an arbitrary Python object.

PyYAML is applicable for a broad range of tasks from complex configuration files to object serialization and persistance.

[root@test dataload]# tar -zxvf PyYAML-3.10.tar.gz
[root@test PyYAML-3.10]# python setup.py install

3.yaml-0.1.4配置

下载源代码包:http://pyyaml.org/download/libyaml/yaml-0.1.4.tar.gz。编译和安装LibYAML

[root@test dataload]# tar -zxvf yaml-0.1.4.tar.gz
[root@test dataload]# cd yaml-0.1.4
[root@test yaml-0.1.4]# ./configure
[root@test yaml-0.1.4]# make && make install

4.gpload.gpfdist工具配置

下载:greenplum-loaders-4.2.1.0-build-2-RHEL5-x86_64.zip

[root@test dataload]# ./greenplum-loaders-4.2.1.0-build-2-RHEL5-x86_64.bin 

********************************************************************************
    Do you accept the Greenplum Loaders license agreement? [yes | no]
********************************************************************************

 

选择:yes 到安装完成

修改greenplum_loaders_path.sh中GPHOME_LOADERS改为你安装的路径

.bash_profile中添加环境GP变量:

export PGDATABASE=gptest
export PGHOST=127.0.0.1
export PGPORT=5432
export PGUSER=gpadmin
export PGPASSWORD=gpadmin